-- Logs begin at Thu 2022-07-14 10:27:51 UTC, end at Thu 2022-07-14 11:35:31 UTC. -- Jul 14 10:58:10.925632 dv-cinder-848938-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 10:58:10.934552 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 10:58:10 2022] *** Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: nodename: dv-cinder-848938-2-iscsi Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: machine: x86_64 Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: clock source: unix Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: pcre jit disabled Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: detected number of CPU cores: 4 Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: current working directory: / Jul 14 10:58:10.936637 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: detected binary path: /usr/bin/uwsgi-core Jul 14 10:58:10.937320 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: your processes number limit is 47680 Jul 14 10:58:10.937320 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: your memory page size is 4096 bytes Jul 14 10:58:10.937320 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: detected max file descriptor number: 2048 Jul 14 10:58:10.937320 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: lock engine: pthread robust mutexes Jul 14 10:58:10.937320 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: thunder lock: enabled Jul 14 10:58:10.937320 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 10:58:10.937320 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 10:58:10.981588 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: Python main interpreter initialized at 0x55d8ca2d19c0 Jul 14 10:58:10.981588 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: python threads support enabled Jul 14 10:58:10.981588 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: your server socket listen backlog is limited to 100 connections Jul 14 10:58:10.981588 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: your mercy for graceful operations on workers is 90 seconds Jul 14 10:58:10.982055 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 10:58:10.982055 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: *** Operational MODE: preforking *** Jul 14 10:58:10.982286 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: *** uWSGI is running in multiple interpreter mode *** Jul 14 10:58:10.982286 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: spawned uWSGI master process (pid: 103358) Jul 14 10:58:10.982495 dv-cinder-848938-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 10:58:10.983063 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: spawned uWSGI worker 1 (pid: 103359, cores: 1) Jul 14 10:58:10.983414 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: spawned uWSGI worker 2 (pid: 103360, cores: 1) Jul 14 10:58:10.983657 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 10:58:11.640195 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:58:11.653880 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:58:12.757823 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:58:12.757823 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jul 14 10:58:12.758553 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:58:12.758553 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: from cryptography.utils import int_from_bytes Jul 14 10:58:12.758930 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:58:12.758930 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jul 14 10:58:12.759042 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:58:12.759042 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: from cryptography.utils import int_from_bytes Jul 14 10:58:15.230330 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:58:15.230956 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:58:15.231121 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:58:15.231463 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:58:15.231719 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:58:15.232100 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.232420 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.232508 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:58:15.232857 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:58:15.232936 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.233022 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.233219 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:58:15.233869 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.234125 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:58:15.234228 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.234380 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:58:15.234476 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.234766 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.234859 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.235082 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.235166 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.235335 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.235533 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.235668 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.235764 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.235992 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848938-2-iscsi {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.236081 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.236304 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.236400 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.236602 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.236687 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.236908 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.236992 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.237219 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.237305 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.237499 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.237590 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.237813 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.237913 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.238108 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.238191 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848938-2-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.238439 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.238595 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.238744 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.239773 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.239908 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.240024 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.240157 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.240287 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.240418 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.240547 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.240681 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.240813 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.240932 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.241052 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.241186 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.241322 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.241450 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.241579 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.241700 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.241826 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.241956 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.242085 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.242210 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.242341 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848938-2-iscsi {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.242541 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.242665 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.242791 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.242912 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.243045 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.243175 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.243307 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.243457 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.243582 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.243702 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.243821 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.243952 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.244143 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848938-2-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.244269 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.244456 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.244592 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.244767 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.244903 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.245078 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.245225 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.245469 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.245601 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.245753 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.245880 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.246067 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.246201 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.246363 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.246491 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.246664 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.246790 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.246966 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.247093 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.247272 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.247430 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.247596 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.247722 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.247892 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.248020 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.248142 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.248263 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.248425 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.248559 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.248741 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.248867 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.249592 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.249733 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.249908 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.250048 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.250173 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.250301 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.250431 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.250554 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.250689 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.250824 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.250979 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.251106 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.251279 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.251467 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.251611 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.251742 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.251872 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.252000 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.252175 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.252310 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.252449 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.252573 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.252757 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.252889 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.253055 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.253190 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.253354 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.253492 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.253659 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.253784 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.253963 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.254100 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.254268 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.254391 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.254566 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.254690 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.254867 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.254999 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.255173 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.255308 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.255499 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.255628 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.255799 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.255933 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.256120 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.256244 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.256435 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.256566 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.256735 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.256870 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.257044 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.257180 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.257355 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.257479 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.257654 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.257781 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.257952 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.258078 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.258250 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.258382 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.258560 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.258686 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.258883 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.259009 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.259181 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.259307 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.259480 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.259606 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.259735 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.259858 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.260025 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.260171 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.260336 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.260462 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.260635 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.260768 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.260933 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.261070 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.261231 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.261357 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.261522 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.261648 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.261819 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.261953 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.262120 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.262245 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.262416 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.262540 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.262714 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.262848 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.263012 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.263137 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.263307 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.263475 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.263609 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.263740 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.263919 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.264046 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.264213 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.264338 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.264517 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.264649 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.264848 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.264975 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.265143 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.265276 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.265440 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.265567 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.265736 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.265875 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.266039 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.266164 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.266344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.266479 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.266638 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.266772 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.266934 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.267059 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.267249 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.267373 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.267558 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.267694 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.267854 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.267980 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.268156 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.268293 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.268454 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.268578 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.268752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.268877 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.269053 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.269179 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.269341 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.269466 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.269638 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.269772 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.269942 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.270070 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.270239 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.270365 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.270537 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.270662 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.270831 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.270968 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.271127 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.271252 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.271440 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.271586 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.271739 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.271873 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.272032 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.272158 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.272328 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.272467 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.272619 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.272744 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.272917 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.273041 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.273263 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.273395 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.273518 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.273639 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.273795 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.273928 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.274089 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.274226 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.274389 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.274521 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.274686 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.274812 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.275001 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.275136 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.275319 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.275465 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.275649 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.275794 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.275938 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.276062 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.276241 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.276367 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.276555 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:58:15.276691 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.276871 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.277004 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.277176 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.277302 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.277494 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.277619 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.277798 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.277926 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.278101 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.278227 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.278402 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.278539 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.278708 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.278842 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.279016 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.279149 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.279336 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.279496 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.279667 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.279793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.279974 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.280100 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.280307 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.280447 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.280611 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.280802 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.280928 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.281226 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.281357 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.281539 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.281695 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.281841 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.282034 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.282163 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.282356 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.282500 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.282677 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.282804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.282996 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.283131 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.283312 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.283475 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.283655 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.283783 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.283984 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.284110 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.284289 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.284416 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.284602 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.284736 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.284922 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.285055 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.285224 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.285351 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.285533 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.285660 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.285834 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.285960 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.286142 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.286271 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.286443 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.286572 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.286744 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.286868 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.287044 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.287170 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.287369 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.287544 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.287697 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.287831 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.288006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.288130 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.288310 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.288441 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.288619 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.288823 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.288949 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.289079 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.289202 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.289322 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.289495 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.289629 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.289792 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.289917 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.290087 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.290212 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.290382 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.290516 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.290684 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.290809 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.290979 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.291104 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.291290 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.291436 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.291631 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.291756 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.291929 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.292053 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.292230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.292371 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.292529 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.292664 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.292836 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.293141 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.293285 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.293443 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.293570 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.293744 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.293881 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.294039 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.294176 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.294343 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.294470 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.294644 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.294781 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.294939 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.295079 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.295251 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.295410 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.295578 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.295706 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.296386 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.296515 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.296696 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.296833 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.296993 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.297203 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.297340 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.297464 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.297582 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.297704 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.297871 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.297998 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.298174 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.298301 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.298477 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.298603 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.298781 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.298906 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.299095 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.299229 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.299417 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.299584 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.299719 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.299923 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.300052 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.300251 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.300376 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.300565 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.300691 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.300876 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.301004 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.301189 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.301315 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.301500 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.301626 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.301804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.301929 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.302106 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.302233 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.302400 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.302535 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.302696 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.302830 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.302990 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.303117 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.303290 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.303446 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.303620 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.303733 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.303916 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.304028 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.304212 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.304332 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.304508 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.304628 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.304807 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.305028 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.305237 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.305456 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.305658 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.305888 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.306081 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.306214 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.306348 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.306481 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.306605 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.306716 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.306837 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.306959 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.307156 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.307515 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.307515 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.307760 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.307876 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.307995 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.308359 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.308476 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.308600 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.308729 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.308851 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.308979 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.309114 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.309237 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.309360 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.309480 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.309608 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.309743 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.309875 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.309997 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.310118 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.310222 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.310420 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.310647 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.310854 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.311052 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.311257 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.311524 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.312228 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.312458 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.312681 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.312828 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.312954 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.313077 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.313199 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.313331 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.313456 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.313580 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.313713 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.313836 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.313966 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.314099 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.314222 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.314351 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.314474 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.314599 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.314730 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.314854 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.315049 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.315256 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.315539 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.315747 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.315938 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.316122 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.316309 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.316483 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.316661 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.316822 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.316959 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.317082 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.317204 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.317326 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.317448 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.317570 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.317702 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.317826 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.317948 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.318077 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.318277 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.318411 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.318613 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.318748 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.318879 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.319001 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.319123 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.319253 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.319395 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.319521 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.319654 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.319778 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.319900 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.320030 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.320154 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.320275 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.320396 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.320517 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.320640 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.320769 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.320894 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.321016 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.321147 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.321325 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.321460 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.321618 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.321744 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.321916 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.322042 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.322217 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.322352 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.322524 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.322651 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.322825 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.322961 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.323127 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.323268 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.323438 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.323563 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.323740 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.323867 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.324038 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.324176 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.324332 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.324466 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.324625 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.324752 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.324927 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.325064 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.325231 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.325358 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.325529 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.325653 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.325838 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.325977 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.326144 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.326269 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.326435 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.326560 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.326735 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.326876 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.327060 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.327199 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.327363 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.327506 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.327680 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.327816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.327976 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.328110 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.328268 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.328402 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.328593 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.328720 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.328949 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.329090 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.329219 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.329351 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.329474 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.329597 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.329760 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.329894 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.330059 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.330194 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.330363 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.330498 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.330662 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.330798 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.330960 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.331100 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.331259 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.331427 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.331593 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.331719 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.331893 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.332029 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.332194 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.332328 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.332493 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.332628 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.332791 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.332919 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.333091 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.333210 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.333404 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.333531 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.333704 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.333831 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.334003 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.334129 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.334301 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.334427 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.334594 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.334735 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.334894 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.335020 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.335200 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.335326 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.335526 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.335796 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.335923 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.336121 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.336247 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.336430 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.336566 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.336734 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.336859 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.337042 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.337167 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.337349 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.337476 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.337656 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.337783 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.337962 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.338096 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.338276 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.338411 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.338584 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.338844 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.338971 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.339167 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.339291 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.339481 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.339615 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.339775 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.339902 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.340073 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.340322 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.340468 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.340593 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.340715 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.340838 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.340960 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.341090 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.341222 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.341368 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.341510 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.341714 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.341842 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.341965 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.342088 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.342259 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.342395 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.342561 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.342732 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.342901 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.343042 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.343205 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.343325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.343533 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.343662 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.343838 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.343979 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.344132 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.344256 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.344428 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.344553 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.344722 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.344857 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.345022 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.345147 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.345325 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.345452 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.345645 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.345787 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.345936 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.346065 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.346246 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.346372 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.346548 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.346676 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.346853 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.346978 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.347163 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.347288 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.347466 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.347591 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.347765 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.347899 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.348063 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.348191 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.348368 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.348503 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.348948 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.349079 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.349249 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.349375 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.349551 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.349679 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.349851 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.349977 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.350152 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.350288 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.350454 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.350580 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.350749 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.350875 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.351049 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.351185 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.351344 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.351489 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.351676 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.351813 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.351975 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.352111 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.352270 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.352405 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.352564 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.352691 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.352865 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.353000 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.353166 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.353304 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.353462 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.353589 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.353763 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.353890 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.354057 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.354183 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.354362 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.354489 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.354655 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.354780 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.354949 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.355084 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.355243 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.355363 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.355567 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.355703 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.355863 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.355995 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.356157 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.356291 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.356462 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.356588 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.356763 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.356890 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.357055 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.357192 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.357349 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.357475 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.357647 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.357773 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.357940 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.358076 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.358232 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.358897 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.359061 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.359195 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.359367 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.359528 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.359707 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.359865 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.359989 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.360110 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.360274 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.360412 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.360568 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.360696 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.360861 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.360996 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.361153 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.361281 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.361449 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.361575 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.361742 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.361877 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.362035 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.362162 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.362326 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.362463 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.362619 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.362746 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.362911 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.363042 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.363221 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.363346 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.363544 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.363670 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.363839 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.363974 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.364135 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.364262 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.364427 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.364562 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.364731 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.364856 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.365032 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.365168 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.365334 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.365462 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.365635 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.365762 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.365935 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.366063 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.366235 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.366374 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.366536 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.366660 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.366837 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.366964 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.367136 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.367269 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.367451 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.367577 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.367753 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.367877 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.368051 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.368184 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.368355 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.368482 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.368648 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.368774 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.368944 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.369079 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.369254 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.369380 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.369556 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.369682 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.369881 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.370007 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.370153 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.370279 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.370464 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.370591 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.370777 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.370905 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.371071 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.371206 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.371373 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.371520 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.371701 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.371828 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.372002 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.372128 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.372301 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.372439 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.372601 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.372726 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.372900 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.373019 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.373203 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.373340 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.373503 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.373621 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.373805 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.373973 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.374652 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.374816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.374947 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.375070 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.375244 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.375371 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.375569 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.375710 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.375875 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.375998 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.376165 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.376291 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.376467 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.376595 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.376763 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.376889 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.377065 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.377198 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.377365 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.377485 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.377665 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.377793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.377961 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.378094 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.378272 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.378406 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.378582 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.378708 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.378889 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.379023 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.379191 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.379311 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.379536 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.379665 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.379842 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.379976 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.380145 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.380269 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.380450 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.380574 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.380744 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.380890 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.381052 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.381183 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.381355 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.381490 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.381736 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.381869 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.382040 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.382173 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.382338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.382464 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.382633 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.382768 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.382933 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.383059 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.383248 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.383373 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.383579 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.383700 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.383876 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.384041 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.384165 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.384286 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.384470 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.384597 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.384767 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.384901 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.385076 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.385205 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.385465 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.385592 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.385770 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.385905 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.386066 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.386197 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.386370 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.386503 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.386691 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.386818 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.386996 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.387130 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.387299 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.387463 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.387625 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.387753 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.387946 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.388083 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.388256 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.388389 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.388560 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.388691 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.388864 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.388999 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.389180 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.389305 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.389494 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.389640 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.389820 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.389985 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.390133 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.390296 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.390423 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.390605 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.390890 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.391011 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.391274 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.391430 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.391628 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.391753 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.391956 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.392081 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.392268 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.392404 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.392586 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.392713 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.392900 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.393027 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.393226 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.393351 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.393523 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.393648 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.393818 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.393944 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.394123 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.394259 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.394418 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.394544 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.394712 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.394839 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.395023 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.395159 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.395319 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.395502 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.395648 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.395790 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.395949 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.396076 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.396249 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.396376 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.396543 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.396681 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.396835 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.396996 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.397150 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.397322 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.397458 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.397629 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.397757 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.397934 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.398062 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.398247 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.398373 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.398542 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.398670 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.398846 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.398975 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.399166 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.399303 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.399494 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.399623 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.399805 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.399932 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.400101 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.400238 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.400397 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.400524 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.400697 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.400829 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.401000 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.401136 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.401312 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.401437 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.401610 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.401735 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.401930 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.402065 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.402230 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.402355 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.402551 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.402686 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.402868 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.402993 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.403169 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.403294 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.403499 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.403626 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.403808 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.403927 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.404103 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.404240 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.404398 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.404524 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.404698 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.404824 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.404993 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.405117 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.405823 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.405951 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.406120 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.406248 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.406420 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.406547 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.406714 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.406855 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.407008 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.407142 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.407302 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.407452 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.407654 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.407783 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.407949 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.408077 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.408262 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.408399 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.408559 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.408695 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.408854 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.408981 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.409148 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.409283 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.409441 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.409616 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.409773 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.409900 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.410069 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.410195 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.410390 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.410518 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.410692 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.410816 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.410993 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.411132 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.411296 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.411485 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.411610 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.411733 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.411927 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.412053 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.412227 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.412353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.412530 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.412655 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.412835 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.412962 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.413134 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.413260 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.413436 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.413561 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.413734 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.413871 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.414038 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.414173 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.414337 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.414463 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.414643 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.414779 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.414948 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.415084 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.415256 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.415400 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.415624 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.415824 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.415945 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.416151 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.416279 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.416463 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.416589 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.416793 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.416952 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.417076 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.417198 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.417357 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.417493 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.417667 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.417794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.417973 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.418100 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.418277 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.418413 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.418582 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.418716 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.418884 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.419019 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.419203 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.419338 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.419538 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.419664 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.419853 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.420081 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.420220 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.420411 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.420538 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.420727 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.420896 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.421593 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.421728 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.421908 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.422033 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.422220 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.422345 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.422532 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.422666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.422843 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.422975 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.423153 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.423278 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.423485 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.423620 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.423796 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.423928 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.424102 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.424240 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.424438 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.424562 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.424685 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.424805 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.424981 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.425108 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.425283 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.425410 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.425585 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.425718 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.425890 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.426027 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.426192 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.426316 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.426503 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.426634 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.426828 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.426964 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.427141 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.427275 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.427468 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.427606 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.427768 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.427897 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.428076 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.428204 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.428402 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.428586 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.428725 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.428891 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.429018 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.429215 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.429342 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.429528 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.429664 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.429842 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.429969 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.430149 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.430275 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.430459 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.430587 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.430775 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.430906 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.431070 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.431196 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.431365 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.431514 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.431689 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.431828 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.431988 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.432115 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.432283 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.432410 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.432593 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.432847 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.432974 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.433416 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.433557 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.433727 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.433852 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.434028 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.434163 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.434367 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.434550 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.434677 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.434891 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.435017 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.435199 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.435334 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.435539 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.435667 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.435857 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.435984 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.436166 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.436306 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.436505 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.436634 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.436809 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.436940 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.437109 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.437249 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.437407 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.437533 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.437714 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.437838 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.438015 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.438148 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.438311 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.438438 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.438606 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.438851 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.438987 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.439195 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.439323 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.439513 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.439650 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.439815 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.439951 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.440108 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.440235 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.440425 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.440559 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.440720 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.440849 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.441013 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.441148 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.441309 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.441437 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.441610 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.441745 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.441904 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.442031 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.442199 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.442329 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.442496 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.442624 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.442790 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.442917 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.443092 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.443219 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.443417 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.443566 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.443744 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.443876 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.443999 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.444131 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.444283 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.444411 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.444578 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.444705 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.444878 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.445013 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.445183 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.445308 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.445486 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.445615 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.445799 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.445934 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.446066 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.446194 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.446375 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.446502 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.446677 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.446813 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.446980 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.447108 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.447281 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.447428 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.447606 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.447746 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.447915 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.448043 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.448220 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.448347 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.448535 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.448756 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.448884 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.449086 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.449213 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.449402 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.449542 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.449728 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.449857 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.450052 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.450179 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.450352 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.450487 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.450652 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.450777 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.450952 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.451085 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.451268 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.451424 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.451596 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.451730 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.451899 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.452053 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.452237 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.452366 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.452540 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.452667 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.452841 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.453095 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.453301 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.453439 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.453564 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.453715 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.453841 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.454015 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.454156 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.454314 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.454441 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.454614 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.454740 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.454913 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.455042 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.455212 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.455338 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.455541 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.455668 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.455873 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.456000 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.456181 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.456306 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.456489 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.456615 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.456792 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.456919 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.457099 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.457226 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.457402 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.457541 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.457706 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.457832 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.458005 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.458130 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.458305 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.458440 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.458610 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.458737 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.458915 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.459048 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.459217 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.459351 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.459536 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.459676 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.459849 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.459975 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.460188 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.460317 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.460504 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.460639 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.460818 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.460945 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.461115 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.461241 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.461425 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.461551 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.461730 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.461854 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.462029 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.462156 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.462336 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.462470 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.462635 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.462759 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.462945 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.463071 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.463269 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.463416 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.463603 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.463741 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.463906 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.464034 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.464213 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.464337 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.464510 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.464647 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.464806 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.464944 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.465106 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.465233 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.465414 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.465551 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.465713 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.465839 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.466006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.466134 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.466299 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.466427 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.466598 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.466726 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.466891 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.467018 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.467184 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.467320 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.467582 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.468418 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.468546 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.468719 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.468859 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.469014 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.469154 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.469310 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.469471 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.469606 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.469778 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.469906 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.470082 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.470209 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.470392 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.470528 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.470711 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.470841 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.471014 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.471148 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.471309 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.471469 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.471630 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.471765 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.471926 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.472060 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.472219 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.472355 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.472524 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.472650 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.472829 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.472956 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.473133 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.473260 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.473439 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.473567 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.473740 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.473865 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.474040 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.474173 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.474339 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.474472 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.474638 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.474764 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.474942 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.475078 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.475243 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.475370 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.475556 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.475677 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.475865 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.475992 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.476167 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.476291 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.476464 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.476596 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.476764 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.476888 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.477064 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.477189 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.477364 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.477499 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.477671 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.477805 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.477987 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.478115 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.478302 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.478438 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.478600 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.478734 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.478913 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.479040 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.479219 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.479353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.479552 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.479677 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.479859 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.479985 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.480161 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.480291 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.480473 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.480599 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.480772 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.480897 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.481074 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.481203 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.481373 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.481501 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.481673 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.481800 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.481996 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.482130 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.482261 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.482385 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.482552 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.482693 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.482853 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.482980 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.483159 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.483304 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.484065 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.484204 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.484395 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.484507 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.484712 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.484850 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.485011 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.485148 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.485325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.485454 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.485633 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.485760 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.485961 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.486099 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.486263 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.486397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.486570 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.486689 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.486879 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.487007 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.487186 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.487314 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.487513 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.487653 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.487819 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.487948 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.488075 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:58:15.488199 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.488424 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.488739 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.489053 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.489383 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.489707 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.490017 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.490338 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.490662 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.491007 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.491319 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.491707 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.492036 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.492350 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.492662 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.492966 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:58:15.493210 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:58:15.549038 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO dbcounter [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Registered counter for database nova_api Jul 14 10:58:15.555192 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Registered counter for database nova_api Jul 14 10:58:15.661977 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_db.sqlalchemy.engines [None req-35817d79-9936-4622-91e9-f4964497b592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:58:15.666277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:58:15.669111 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writer thread running {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:58:15.673609 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:58:15.725211 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.context [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e1441d4-0d48-4768-9ce5-52c16a7d55c5(cell1) {{(pid=103359) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:58:15.729071 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:15.729233 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.context [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e1441d4-0d48-4768-9ce5-52c16a7d55c5(cell1) {{(pid=103360) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:58:15.730647 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:15.731449 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:15.733057 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:15.734128 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:15.735234 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:15.736051 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:15.736145 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO dbcounter [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Registered counter for database nova_cell0 Jul 14 10:58:15.738185 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:15.740178 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Registered counter for database nova_cell0 Jul 14 10:58:15.740289 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO dbcounter [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Registered counter for database nova_cell1 Jul 14 10:58:15.744001 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Registered counter for database nova_cell1 Jul 14 10:58:15.748068 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_db.sqlalchemy.engines [None req-35817d79-9936-4622-91e9-f4964497b592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:58:15.750258 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_db.sqlalchemy.engines [None req-35817d79-9936-4622-91e9-f4964497b592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:58:15.752001 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:58:15.754111 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:58:15.754521 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writer thread running {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:58:15.758652 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:58:15.764219 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:58:15.891573 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writer thread running {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:58:15.901826 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO dbcounter [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Registered counter for database nova_cell0 Jul 14 10:58:15.906754 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Registered counter for database nova_cell0 Jul 14 10:58:15.912166 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_db.sqlalchemy.engines [None req-35817d79-9936-4622-91e9-f4964497b592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:58:15.916583 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writer thread running {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:58:15.918020 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:58:15.922381 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:58:16.250978 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: WARNING keystonemiddleware.auth_token [None req-35817d79-9936-4622-91e9-f4964497b592 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:58:16.258320 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: WARNING keystonemiddleware.auth_token [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:58:16.260385 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:58:16.268327 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:58:16.597170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: WARNING keystonemiddleware.auth_token [None req-35817d79-9936-4622-91e9-f4964497b592 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:58:16.603013 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: WARNING keystonemiddleware.auth_token [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:58:16.607986 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:58:16.608237 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8ca2d19c0 pid: 103359 (default app) Jul 14 10:58:16.610861 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:16.612057 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-35817d79-9936-4622-91e9-f4964497b592 None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Jul 14 10:58:16.612459 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Thu Jul 14 10:58:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:16.614770 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-7cd218da-0c89-4ac0-b0ec-8089dbdfc84e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:58:16.620110 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8ca2d19c0 pid: 103360 (default app) Jul 14 10:59:33.647305 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:33.648338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-35817d79-9936-4622-91e9-f4964497b592 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 14 10:59:33.648740 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:33.661854 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:33.662801 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:33.663726 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:33.664622 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:34.530261 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-953418e5-c5fa-4d4a-a8bc-0c3c4bd185e4 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:34.560689 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-953418e5-c5fa-4d4a-a8bc-0c3c4bd185e4 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905150 Jul 14 10:59:34.561423 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1291 bytes} [Thu Jul 14 10:59:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:36.815803 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-35817d79-9936-4622-91e9-f4964497b592 None None] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:36.817475 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-35817d79-9936-4622-91e9-f4964497b592 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Jul 14 10:59:36.818281 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:37.334120 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-1e509403-29fb-4d3f-b942-c177100351cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "swap": 0, "id": "c1", "name": "cirros256", "disk": 1}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:37.352512 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:59:37.352512 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jul 14 10:59:37.382047 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-1e509403-29fb-4d3f-b942-c177100351cf admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.557437 Jul 14 10:59:37.382906 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 10:59:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:59:37.397499 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_api:SELECT=3 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:37.398699 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_cell1:SELECT=3 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:37.399504 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_cell0:SELECT=3 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:37.400351 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:37.611945 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-97def30c-4924-49cc-b35d-81c43a3facac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:37.614457 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:59:37.614457 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: warnings.warn(msg) Jul 14 10:59:37.680912 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-97def30c-4924-49cc-b35d-81c43a3facac admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288932 Jul 14 10:59:37.681700 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1335 bytes} [Thu Jul 14 10:59:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:59:39.982292 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-1e509403-29fb-4d3f-b942-c177100351cf admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:39.983885 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-1e509403-29fb-4d3f-b942-c177100351cf admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Jul 14 10:59:39.989338 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:40.734835 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-15b36698-8fb9-4a83-bde2-dca77957efc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "ram": 512, "vcpus": 1}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:40.753693 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:59:40.753693 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: warnings.warn(msg) Jul 14 10:59:40.778193 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-15b36698-8fb9-4a83-bde2-dca77957efc5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.786681 Jul 14 10:59:40.778760 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 10:59:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:59:40.791355 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-93b85f28-8eac-4fd6-8ceb-1a660e7b3491 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:40.792907 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:59:40.792907 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jul 14 10:59:40.827035 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-93b85f28-8eac-4fd6-8ceb-1a660e7b3491 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039403 Jul 14 10:59:40.828110 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1335 bytes} [Thu Jul 14 10:59:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:43.144527 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-15b36698-8fb9-4a83-bde2-dca77957efc5 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:43.145546 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-15b36698-8fb9-4a83-bde2-dca77957efc5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 14 10:59:43.145946 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:43.577612 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-96756949-52b0-4347-813d-2ee9c223c74f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "id": "d2"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:43.596243 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-96756949-52b0-4347-813d-2ee9c223c74f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444039 Jul 14 10:59:43.596826 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 10:59:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:59:43.609442 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-7a7bd2b1-9ba9-4bcf-b7a2-3bf18a0d3c7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:43.633827 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-7a7bd2b1-9ba9-4bcf-b7a2-3bf18a0d3c7c admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028577 Jul 14 10:59:43.634560 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1335 bytes} [Thu Jul 14 10:59:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:59:45.883194 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-96756949-52b0-4347-813d-2ee9c223c74f admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:45.884279 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-96756949-52b0-4347-813d-2ee9c223c74f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Jul 14 10:59:45.884647 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:46.362759 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-6ebb6568-9bd0-4872-9ba1-580af9f63717 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "disk": 10}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:46.389117 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-6ebb6568-9bd0-4872-9ba1-580af9f63717 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497697 Jul 14 10:59:46.391147 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 10:59:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:59:46.404947 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c5fd85f0-1a26-4271-b6f0-b914ce4f8fc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:46.439511 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c5fd85f0-1a26-4271-b6f0-b914ce4f8fc8 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035859 Jul 14 10:59:46.440960 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1335 bytes} [Thu Jul 14 10:59:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:48.693352 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-6ebb6568-9bd0-4872-9ba1-580af9f63717 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:48.693352 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-6ebb6568-9bd0-4872-9ba1-580af9f63717 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jul 14 10:59:48.703485 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:49.162830 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-21b1ae6f-9932-4956-8740-7b1772067a4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:49.181881 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-21b1ae6f-9932-4956-8740-7b1772067a4d admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482375 Jul 14 10:59:49.182632 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 10:59:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:59:49.194672 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-306ba865-2654-4f1a-bbab-28a0ea26029a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:49.220061 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-306ba865-2654-4f1a-bbab-28a0ea26029a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029011 Jul 14 10:59:49.221212 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1335 bytes} [Thu Jul 14 10:59:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:51.739864 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-21b1ae6f-9932-4956-8740-7b1772067a4d admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:51.741207 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-21b1ae6f-9932-4956-8740-7b1772067a4d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Jul 14 10:59:51.741685 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:52.173507 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-f5f31f48-2bee-4f6e-a782-c1d8b2396c40 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:52.198478 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-f5f31f48-2bee-4f6e-a782-c1d8b2396c40 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448100 Jul 14 10:59:52.199227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1291 bytes} [Thu Jul 14 10:59:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:54.838556 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-21b1ae6f-9932-4956-8740-7b1772067a4d admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:54.839692 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-21b1ae6f-9932-4956-8740-7b1772067a4d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 14 10:59:54.840304 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:55.291647 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-ebb22564-d2a1-466e-913b-77606d2bfea6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:55.321151 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-ebb22564-d2a1-466e-913b-77606d2bfea6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.473448 Jul 14 10:59:55.326297 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 10:59:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:59:55.335562 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-75616aa4-e794-404a-bf33-c4c116f74f22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:55.363281 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-75616aa4-e794-404a-bf33-c4c116f74f22 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032549 Jul 14 10:59:55.363893 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1332 bytes} [Thu Jul 14 10:59:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:57.596606 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-ebb22564-d2a1-466e-913b-77606d2bfea6 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:57.597607 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-ebb22564-d2a1-466e-913b-77606d2bfea6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 14 10:59:57.598009 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 10:59:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:58.046241 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3fbf7f7e-ae07-46ba-aa93-5899faa4cda5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "swap": 0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:58.065891 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3fbf7f7e-ae07-46ba-aa93-5899faa4cda5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462018 Jul 14 10:59:58.066454 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 10:59:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:59:58.079095 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-237de7e1-0a1e-4209-bd14-af15930096ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:58.104151 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-237de7e1-0a1e-4209-bd14-af15930096ff admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028676 Jul 14 10:59:58.104742 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1332 bytes} [Thu Jul 14 10:59:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:00.420402 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3fbf7f7e-ae07-46ba-aa93-5899faa4cda5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:00.421442 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3fbf7f7e-ae07-46ba-aa93-5899faa4cda5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 14 11:00:00.422332 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 11:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:00.834195 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-c152b475-7684-4165-bd43-ebe42d640c1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:00.855974 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-c152b475-7684-4165-bd43-ebe42d640c1e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.427858 Jul 14 11:00:00.856548 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 11:00:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:00:00.868772 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d512a450-4492-4ce6-a414-f3d2bd1b5c57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:00.896583 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-d512a450-4492-4ce6-a414-f3d2bd1b5c57 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031492 Jul 14 11:00:00.899520 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1332 bytes} [Thu Jul 14 11:00:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:03.237514 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-c152b475-7684-4165-bd43-ebe42d640c1e admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:03.238433 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-c152b475-7684-4165-bd43-ebe42d640c1e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 14 11:00:03.239094 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 11:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:03.676172 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-7eaa1e64-8dd9-472e-8574-c83cd7301263 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:03.698401 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-7eaa1e64-8dd9-472e-8574-c83cd7301263 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453796 Jul 14 11:00:03.699096 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 11:00:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:00:03.710746 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-d95566b4-ca3c-42e3-a141-039cb6ec6101 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:03.736077 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-d95566b4-ca3c-42e3-a141-039cb6ec6101 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028873 Jul 14 11:00:03.736775 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1332 bytes} [Thu Jul 14 11:00:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:06.072177 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-7eaa1e64-8dd9-472e-8574-c83cd7301263 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:06.073194 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-7eaa1e64-8dd9-472e-8574-c83cd7301263 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 14 11:00:06.073634 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 11:00:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:06.551276 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-119294f6-7661-4d52-bff1-143798b0b064 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:06.570355 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-119294f6-7661-4d52-bff1-143798b0b064 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.490656 Jul 14 11:00:06.570912 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1282 bytes} [Thu Jul 14 11:00:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:00:06.583340 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-41855409-cac3-4e9c-89f4-a286f804da15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:06.591044 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:06.611251 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-41855409-cac3-4e9c-89f4-a286f804da15 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031534 Jul 14 11:00:06.612080 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1332 bytes} [Thu Jul 14 11:00:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:26.493268 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-119294f6-7661-4d52-bff1-143798b0b064 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:26.494268 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-119294f6-7661-4d52-bff1-143798b0b064 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 14 11:00:26.494664 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 11:00:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:26.878318 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-1cd279c2-1f2c-4c7a-b145-09949f287447 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:26.897561 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-1cd279c2-1f2c-4c7a-b145-09949f287447 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396253 Jul 14 11:00:26.898097 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1291 bytes} [Thu Jul 14 11:00:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:27.968391 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-119294f6-7661-4d52-bff1-143798b0b064 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:27.969392 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-119294f6-7661-4d52-bff1-143798b0b064 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 14 11:00:27.969792 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:00:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:28.497308 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-57dad033-52b1-4788-bd6e-4051fcdeafff admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:28.502883 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-57dad033-52b1-4788-bd6e-4051fcdeafff admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-57dad033-52b1-4788-bd6e-4051fcdeafff admin admin] Request method failure captured: Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Accept: application/json Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Host: 10.222.0.75 Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABiz_dLDEWZ5zuhr9lXMHESDXtBjsPbOPQLxpPuD3LWrimTTAhjv5cOdA1emQcq28GPgir3g8kHYd1HXf18w1zf3Uq80zu1b5-PMCvYs42YpXhTDxrAI9c6dkAW9O4mmITY3zDOvrytQAavcfPJqIR2JF-Q9DMmr4362eOuxBfEfOZDG2o Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jul 14 11:00:28.506135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_75fd150c50ce43f4ac09652ce03bfda1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User: admin Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Id: eae05ea06648449e9eda17d7c9a3f3fb Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: method: > Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: exception: Flavor 42 could not be found. Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: action_args: {'id': '42'} Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:00:28.507794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:28.508817 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.510230 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-57dad033-52b1-4788-bd6e-4051fcdeafff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:00:28.511575 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-57dad033-52b1-4788-bd6e-4051fcdeafff admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.400644 Jul 14 11:00:28.511575 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Thu Jul 14 11:00:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:28.517769 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-1c6a1a1a-491b-4b56-b364-e379cdc33130 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:28.520790 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:28.541196 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-1c6a1a1a-491b-4b56-b364-e379cdc33130 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026927 Jul 14 11:00:28.541757 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Jul 14 11:00:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:00:28.551672 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-bad7eda0-1fc0-48da-a44d-5a1e87e9a9c4 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:28.572970 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-bad7eda0-1fc0-48da-a44d-5a1e87e9a9c4 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024796 Jul 14 11:00:28.573552 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Jul 14 11:00:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:28.584282 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-ec4de6da-692e-4b2f-8c7d-07c3c1c80540 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:28.590981 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.wsgi [None req-ec4de6da-692e-4b2f-8c7d-07c3c1c80540 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-ec4de6da-692e-4b2f-8c7d-07c3c1c80540 admin admin] Request method failure captured: Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Accept: application/json Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Accept-Encoding: gzip, deflate Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Connection: keep-alive Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Content-Length: 0 Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Host: 10.222.0.75 Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Openstack-Api-Version: compute 2.90 Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Openstack-System-Scope: None Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: User-Agent: python-novaclient Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Auth-Token: gAAAAABiz_dLDEWZ5zuhr9lXMHESDXtBjsPbOPQLxpPuD3LWrimTTAhjv5cOdA1emQcq28GPgir3g8kHYd1HXf18w1zf3Uq80zu1b5-PMCvYs42YpXhTDxrAI9c6dkAW9O4mmITY3zDOvrytQAavcfPJqIR2JF-Q9DMmr4362eOuxBfEfOZDG2o Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Domain-Id: None Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Domain-Name: None Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Identity-Status: Confirmed Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Is-Admin-Project: True Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Id: default Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Name: Default Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Name: admin Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Role: reader,member,admin Jul 14 11:00:28.594227 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Roles: reader,member,admin Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_75fd150c50ce43f4ac09652ce03bfda1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant: admin Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant-Name: admin Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User: admin Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Id: default Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Name: Default Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Id: eae05ea06648449e9eda17d7c9a3f3fb Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Name: admin Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: method: > Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: exception: Flavor 42 could not be found. Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: action_args: {'id': '42'} Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:00:28.595804 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:28.596666 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:28.597752 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-ec4de6da-692e-4b2f-8c7d-07c3c1c80540 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:00:28.598712 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-ec4de6da-692e-4b2f-8c7d-07c3c1c80540 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015655 Jul 14 11:00:28.598712 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Thu Jul 14 11:00:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:29.574692 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-bad7eda0-1fc0-48da-a44d-5a1e87e9a9c4 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:29.575739 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-bad7eda0-1fc0-48da-a44d-5a1e87e9a9c4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 14 11:00:29.576135 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:30.101451 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8b30b7bf-1cf1-45cb-bf10-a613788f8980 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:30.106762 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.wsgi [None req-8b30b7bf-1cf1-45cb-bf10-a613788f8980 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8b30b7bf-1cf1-45cb-bf10-a613788f8980 admin admin] Request method failure captured: Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Accept: application/json Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Accept-Encoding: gzip, deflate Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Connection: keep-alive Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Content-Length: 0 Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Host: 10.222.0.75 Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Openstack-Api-Version: compute 2.90 Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Openstack-System-Scope: None Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: User-Agent: python-novaclient Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Auth-Token: gAAAAABiz_dNPac_YM9x7Y7s2Hp6mTvfY87T75HJf0xzTx_mBeiRs7Qx4o0e7sI2A67Md9McNc1tDsOUmGxzrWwGQGbW7I2XNXdMs09CuCyNaorDU8RQegV0o6JZiIIQ4ZxMaIWzaVaR4pf5z4dSKwxmY8-Hz2ri0E5D00NeETjy__PLmYd_0yo Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Domain-Id: None Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Domain-Name: None Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Identity-Status: Confirmed Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Is-Admin-Project: True Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Id: default Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Name: Default Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Name: admin Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Role: reader,member,admin Jul 14 11:00:30.108325 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Roles: reader,member,admin Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_75fd150c50ce43f4ac09652ce03bfda1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant: admin Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant-Name: admin Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User: admin Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Id: default Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Name: Default Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Id: eae05ea06648449e9eda17d7c9a3f3fb Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Name: admin Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: method: > Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: exception: Flavor 84 could not be found. Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: action_args: {'id': '84'} Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:00:30.109836 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:30.110776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.112170 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8b30b7bf-1cf1-45cb-bf10-a613788f8980 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:00:30.113409 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-8b30b7bf-1cf1-45cb-bf10-a613788f8980 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396320 Jul 14 11:00:30.113409 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Thu Jul 14 11:00:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:30.119363 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f14b6b8d-d7bd-4b46-ab98-d1901724eb06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:30.132873 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f14b6b8d-d7bd-4b46-ab98-d1901724eb06 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017129 Jul 14 11:00:30.133404 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Jul 14 11:00:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:30.143625 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-ad9c3a02-b34d-4442-aefe-d15f4a35463a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:30.158032 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-ad9c3a02-b34d-4442-aefe-d15f4a35463a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017930 Jul 14 11:00:30.158566 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Jul 14 11:00:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:00:30.167914 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-7aa0ea8c-2338-423d-b129-334d62655017 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:30.173289 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-7aa0ea8c-2338-423d-b129-334d62655017 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-7aa0ea8c-2338-423d-b129-334d62655017 admin admin] Request method failure captured: Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Accept: application/json Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Host: 10.222.0.75 Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABiz_dNPac_YM9x7Y7s2Hp6mTvfY87T75HJf0xzTx_mBeiRs7Qx4o0e7sI2A67Md9McNc1tDsOUmGxzrWwGQGbW7I2XNXdMs09CuCyNaorDU8RQegV0o6JZiIIQ4ZxMaIWzaVaR4pf5z4dSKwxmY8-Hz2ri0E5D00NeETjy__PLmYd_0yo Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jul 14 11:00:30.174793 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_75fd150c50ce43f4ac09652ce03bfda1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User: admin Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Id: eae05ea06648449e9eda17d7c9a3f3fb Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: method: > Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: exception: Flavor 84 could not be found. Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: action_args: {'id': '84'} Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:00:30.176397 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:30.177344 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:30.178887 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-7aa0ea8c-2338-423d-b129-334d62655017 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:00:30.180258 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-7aa0ea8c-2338-423d-b129-334d62655017 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011883 Jul 14 11:00:30.180258 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Thu Jul 14 11:00:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:31.187612 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-ad9c3a02-b34d-4442-aefe-d15f4a35463a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:31.188608 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-ad9c3a02-b34d-4442-aefe-d15f4a35463a admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 14 11:00:31.189192 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:31.735604 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-da789ed0-c707-48ad-a712-0e21856a7bf3 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:31.741320 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-da789ed0-c707-48ad-a712-0e21856a7bf3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-da789ed0-c707-48ad-a712-0e21856a7bf3 admin admin] Request method failure captured: Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Accept: application/json Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Host: 10.222.0.75 Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABiz_dPXEoWROyWgrpfz9W4s-owRTgviW76aDhfUWZtXfaHoMBy6mZjPtyEF0ZaaePex4A9Wew1bXiWQaYaiOBVu2gvZxB1pqRxmu4IRbkGtQpcAWzlT-dkeybv8RJeYu_DdP5wdvqFHeQhwY0VYOwEsltpW8jOs-MiuJw-mo6m9F4RDos Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jul 14 11:00:31.742816 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_75fd150c50ce43f4ac09652ce03bfda1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User: admin Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Id: eae05ea06648449e9eda17d7c9a3f3fb Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: method: > Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: exception: Flavor 451 could not be found. Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: action_args: {'id': '451'} Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:00:31.744408 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:31.745277 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.747049 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-da789ed0-c707-48ad-a712-0e21856a7bf3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:00:31.748705 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-da789ed0-c707-48ad-a712-0e21856a7bf3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416659 Jul 14 11:00:31.748705 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Jul 14 11:00:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:31.754360 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-7af67f6f-65ff-4c18-bded-e7d587e80705 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:31.767874 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-7af67f6f-65ff-4c18-bded-e7d587e80705 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017064 Jul 14 11:00:31.768402 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Jul 14 11:00:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:31.777711 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:31.792458 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018220 Jul 14 11:00:31.793497 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Jul 14 11:00:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:31.802592 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-74869c38-c028-4ef4-bb8b-c261a2ff426d admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:31.808213 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.wsgi [None req-74869c38-c028-4ef4-bb8b-c261a2ff426d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-74869c38-c028-4ef4-bb8b-c261a2ff426d admin admin] Request method failure captured: Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Accept: application/json Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Accept-Encoding: gzip, deflate Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Connection: keep-alive Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Content-Length: 0 Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Host: 10.222.0.75 Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Openstack-Api-Version: compute 2.90 Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Openstack-System-Scope: None Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: User-Agent: python-novaclient Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Auth-Token: gAAAAABiz_dPXEoWROyWgrpfz9W4s-owRTgviW76aDhfUWZtXfaHoMBy6mZjPtyEF0ZaaePex4A9Wew1bXiWQaYaiOBVu2gvZxB1pqRxmu4IRbkGtQpcAWzlT-dkeybv8RJeYu_DdP5wdvqFHeQhwY0VYOwEsltpW8jOs-MiuJw-mo6m9F4RDos Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Domain-Id: None Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Domain-Name: None Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Identity-Status: Confirmed Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Is-Admin-Project: True Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Id: default Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Name: Default Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Project-Name: admin Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Role: reader,member,admin Jul 14 11:00:31.810338 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Roles: reader,member,admin Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_75fd150c50ce43f4ac09652ce03bfda1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/75fd150c50ce43f4ac09652ce03bfda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant: admin Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant-Id: 75fd150c50ce43f4ac09652ce03bfda1 Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-Tenant-Name: admin Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User: admin Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Id: default Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Name: Default Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Id: eae05ea06648449e9eda17d7c9a3f3fb Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: X-User-Name: admin Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: method: > Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: exception: Flavor 451 could not be found. Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: action_args: {'id': '451'} Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:00:31.811921 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:31.813006 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Jul 14 11:00:31.814353 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-74869c38-c028-4ef4-bb8b-c261a2ff426d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:00:31.815653 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-74869c38-c028-4ef4-bb8b-c261a2ff426d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012612 Jul 14 11:00:31.815653 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Jul 14 11:00:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:32.799735 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:32.800728 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 14 11:00:32.801117 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:33.339619 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-fa3bf470-3e6a-4a64-96b3-92c3502bfbca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:33.360075 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-fa3bf470-3e6a-4a64-96b3-92c3502bfbca admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.422176 Jul 14 11:00:33.360636 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Thu Jul 14 11:00:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:00:34.348658 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:34.349664 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 14 11:00:34.350224 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:00:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:34.905614 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-84d4c5a7-7ff9-4402-894f-acb010350dfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:34.924109 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-84d4c5a7-7ff9-4402-894f-acb010350dfb admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408480 Jul 14 11:00:34.924673 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Thu Jul 14 11:00:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:00:35.910919 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:35.911957 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 14 11:00:35.912352 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:36.468682 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-5d2f7083-4386-4e2d-86ba-186c5f161424 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:36.486885 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-5d2f7083-4386-4e2d-86ba-186c5f161424 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.434666 Jul 14 11:00:36.487482 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Thu Jul 14 11:00:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:00:37.497003 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:37.498102 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Jul 14 11:00:37.498571 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:00:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:38.036727 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-04c3d665-7177-4f49-bddd-fed7f15a7bc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:38.056207 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-04c3d665-7177-4f49-bddd-fed7f15a7bc5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.411971 Jul 14 11:00:38.056684 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Thu Jul 14 11:00:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:00:39.040071 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:39.041067 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 14 11:00:39.041463 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:39.563791 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-80a292b1-5a42-420b-b073-172db763f1ff admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:39.585050 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-80a292b1-5a42-420b-b073-172db763f1ff admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407576 Jul 14 11:00:39.585673 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Thu Jul 14 11:00:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:32.034259 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:32.035297 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3afb67f2-b397-4356-a961-6930e29d2c06 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 14 11:01:32.035746 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 930 bytes} [Thu Jul 14 11:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:32.046835 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:32.432544 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-4ff6b91e-d35d-40da-beb6-9e9eed41736e admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:32.451904 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-4ff6b91e-d35d-40da-beb6-9e9eed41736e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409466 Jul 14 11:01:32.452378 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1291 bytes} [Thu Jul 14 11:01:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:32.473342 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:32.477204 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-008c62e1-3cb0-4c44-b48d-c15592c9bcc5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:32.486216 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-008c62e1-3cb0-4c44-b48d-c15592c9bcc5 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014282 Jul 14 11:01:32.486771 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1282 bytes} [Thu Jul 14 11:01:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:01:32.499367 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-dcdfea06-a70a-4d32-9c25-78741acad12e admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:32.511629 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-dcdfea06-a70a-4d32-9c25-78741acad12e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015820 Jul 14 11:01:32.512188 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1285 bytes} [Thu Jul 14 11:01:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:32.523973 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:32.533298 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012865 Jul 14 11:01:32.533898 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1285 bytes} [Thu Jul 14 11:01:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:32.546036 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-4e81e819-c785-4932-bac9-39fea7cd3bc7 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:32.553776 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-4e81e819-c785-4932-bac9-39fea7cd3bc7 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011348 Jul 14 11:01:32.554328 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1282 bytes} [Thu Jul 14 11:01:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:08.633903 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:08.635301 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 14 11:05:08.635301 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 34/69] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:08.775020 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_api:SELECT=6 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:08.944712 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-d5e06104-c053-4d96-9db0-2cc6dcbd35c1 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:08.945881 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:05:08.945881 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: warnings.warn(msg) Jul 14 11:05:08.947085 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-d5e06104-c053-4d96-9db0-2cc6dcbd35c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:08.947563 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-d5e06104-c053-4d96-9db0-2cc6dcbd35c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:08.948346 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-d5e06104-c053-4d96-9db0-2cc6dcbd35c1 admin admin] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:08.948769 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-d5e06104-c053-4d96-9db0-2cc6dcbd35c1 admin admin] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:08.983899 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-d5e06104-c053-4d96-9db0-2cc6dcbd35c1 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210322 Jul 14 11:05:08.984573 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 36/70] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Jul 14 11:05:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:09.878342 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:09.879362 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 14 11:05:09.879794 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 35/71] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:10.083732 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8e527eee-f257-4513-899f-169436f4b7d2 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:10.084854 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:05:10.084854 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: warnings.warn(msg) Jul 14 11:05:10.086076 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-8e527eee-f257-4513-899f-169436f4b7d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.086533 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-8e527eee-f257-4513-899f-169436f4b7d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.087314 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-8e527eee-f257-4513-899f-169436f4b7d2 admin admin] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.087766 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-8e527eee-f257-4513-899f-169436f4b7d2 admin admin] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.109948 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-8e527eee-f257-4513-899f-169436f4b7d2 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090779 Jul 14 11:05:10.111140 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 37/72] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Jul 14 11:05:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:21.378330 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:21.379320 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 14 11:05:21.379792 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:21.521617 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_cell0:SELECT=4 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:21.522266 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_cell1:SELECT=4 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:21.523075 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG dbcounter [-] [103359] Writing DB stats nova_api:SELECT=8 {{(pid=103359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:21.581905 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-ce60769d-65da-46db-ac80-05b75224a2af admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:21.583370 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:05:21.583370 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: warnings.warn(msg) Jul 14 11:05:21.584598 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-ce60769d-65da-46db-ac80-05b75224a2af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:21.585257 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-ce60769d-65da-46db-ac80-05b75224a2af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:21.585823 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-ce60769d-65da-46db-ac80-05b75224a2af admin admin] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:21.586248 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-ce60769d-65da-46db-ac80-05b75224a2af admin admin] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:21.612264 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-ce60769d-65da-46db-ac80-05b75224a2af admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095257 Jul 14 11:05:21.612849 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 38/74] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Jul 14 11:05:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:05:22.456687 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:22.457693 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-07dd0a7b-4ce5-4313-a416-2c7817ff3ea7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 14 11:05:22.458090 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 37/75] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Jul 14 11:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:22.649938 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-af21b7a4-ff8c-42b4-8a05-37d56e93f06f admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:22.651104 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:05:22.651104 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: warnings.warn(msg) Jul 14 11:05:22.652312 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-af21b7a4-ff8c-42b4-8a05-37d56e93f06f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:22.652753 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-af21b7a4-ff8c-42b4-8a05-37d56e93f06f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:22.653546 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-af21b7a4-ff8c-42b4-8a05-37d56e93f06f admin admin] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:22.653972 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-af21b7a4-ff8c-42b4-8a05-37d56e93f06f admin admin] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:22.676044 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-af21b7a4-ff8c-42b4-8a05-37d56e93f06f admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078625 Jul 14 11:05:22.676602 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 39/76] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Jul 14 11:05:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:06:20.489858 dv-cinder-848938-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 11:06:20.490718 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: Thu Jul 14 11:06:20 2022 - graceful shutdown triggered... Jul 14 11:06:20.491218 dv-cinder-848938-2-iscsi devstack@n-api.service[103359]: Gracefully killing worker 1 (pid: 103359)... Jul 14 11:06:20.491625 dv-cinder-848938-2-iscsi devstack@n-api.service[103360]: Gracefully killing worker 2 (pid: 103360)... Jul 14 11:06:21.491954 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: worker 1 buried after 1 seconds Jul 14 11:06:21.491954 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: worker 2 buried after 1 seconds Jul 14 11:06:21.491954 dv-cinder-848938-2-iscsi devstack@n-api.service[103358]: goodbye to uWSGI. Jul 14 11:06:21.493396 dv-cinder-848938-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 11:06:21.493968 dv-cinder-848938-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 11:06:21.496832 dv-cinder-848938-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 11:06:21.507140 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 11:06:21 2022] *** Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: nodename: dv-cinder-848938-2-iscsi Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: machine: x86_64 Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: clock source: unix Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: pcre jit disabled Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: detected number of CPU cores: 4 Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: current working directory: / Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: detected binary path: /usr/bin/uwsgi-core Jul 14 11:06:21.509208 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: your processes number limit is 47680 Jul 14 11:06:21.510050 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: your memory page size is 4096 bytes Jul 14 11:06:21.510050 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: detected max file descriptor number: 2048 Jul 14 11:06:21.510050 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: lock engine: pthread robust mutexes Jul 14 11:06:21.510050 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: thunder lock: enabled Jul 14 11:06:21.510050 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 11:06:21.510050 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 11:06:21.556134 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: Python main interpreter initialized at 0x55c5595c19c0 Jul 14 11:06:21.556134 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: python threads support enabled Jul 14 11:06:21.556134 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: your server socket listen backlog is limited to 100 connections Jul 14 11:06:21.556134 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: your mercy for graceful operations on workers is 90 seconds Jul 14 11:06:21.556582 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 11:06:21.556582 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: *** Operational MODE: preforking *** Jul 14 11:06:21.556880 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: *** uWSGI is running in multiple interpreter mode *** Jul 14 11:06:21.556880 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: spawned uWSGI master process (pid: 117869) Jul 14 11:06:21.557092 dv-cinder-848938-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 11:06:21.557671 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: spawned uWSGI worker 1 (pid: 117888, cores: 1) Jul 14 11:06:21.558197 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: spawned uWSGI worker 2 (pid: 117889, cores: 1) Jul 14 11:06:21.558492 dv-cinder-848938-2-iscsi devstack@n-api.service[117869]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 11:06:22.234673 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:06:22.249005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:06:23.448179 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:06:23.448179 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: from cryptography.utils import int_from_bytes Jul 14 11:06:23.448896 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:06:23.448896 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: from cryptography.utils import int_from_bytes Jul 14 11:06:23.472170 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:06:23.472170 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: from cryptography.utils import int_from_bytes Jul 14 11:06:23.472812 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:06:23.472812 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: from cryptography.utils import int_from_bytes Jul 14 11:06:25.860246 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:06:25.860913 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:06:25.861750 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:06:25.862295 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:06:25.862658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:06:25.863071 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.863448 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.863774 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.864105 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.864453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.864961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.865547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.865946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.866294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.866564 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.866894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.867231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848938-2-iscsi {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.867601 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.867966 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.868551 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.869170 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.869687 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.870219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.870669 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.871191 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.872416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.872416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.872604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.872923 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.873804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.874127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.874460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.874794 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.875117 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.875457 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.875882 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848938-2-iscsi {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.876209 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.876530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.876854 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.877285 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.877607 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.877924 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.878255 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.878587 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.878905 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.879262 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.879621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.879950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.880281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.880591 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.880907 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.881226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.881555 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.881867 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.882179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.882434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.882748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.883079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.883432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.883765 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.884021 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.884274 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.884602 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.884927 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.885240 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.885556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.885868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.886179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.886491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.886804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.887113 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.887445 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.887774 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.891505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.891505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.891505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.891505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.891505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.891505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.891505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.891505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.892869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.892869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.892869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.892869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.892869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.892869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.892869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.892869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.894126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.894126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.894126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.894126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.894476 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.894558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.894868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.895177 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.895511 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.895820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.896133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.896445 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.896757 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.897069 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.897379 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.897686 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.897996 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.898305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.898614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.898940 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.899273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.899611 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.899923 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.900233 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.900543 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.900871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.901183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.901493 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.901819 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.902131 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.902442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.902766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.903079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.903414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.903739 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.904046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.904899 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.905226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.905540 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.905854 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.906166 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.906478 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.906787 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.907097 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.907437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.907755 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.908062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.908389 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.908715 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.909048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.909342 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.909658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.909987 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.910332 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.910671 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.911024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.911345 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.911786 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.912054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.912384 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.912707 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.913031 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.913370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.913693 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.914013 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.914325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.914655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.915000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.915312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.915666 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.915993 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.916318 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.916638 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.916968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.917306 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.917636 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.917954 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.918303 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.918657 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.918975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.919309 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.919676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.920554 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.920878 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.921405 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.921736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.922079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.922400 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.922731 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.923058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.923374 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.923714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.924035 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.924368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.924701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.925023 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.925347 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.925663 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.925987 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.926306 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.926622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.926939 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.927251 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.927596 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.927906 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.928254 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.928533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.928904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.929219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.929534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.929901 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.930443 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.930766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.931081 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.931434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.931742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.932061 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.932375 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.932690 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.933024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.933343 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.933654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.933983 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.934191 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:06:25.934616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.934765 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:06:25.934922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.934922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.935087 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:06:25.935200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.935338 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:06:25.935619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:06:25.935858 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.935997 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.936181 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.936307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.936499 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.936648 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.936845 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.937047 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.937397 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.937524 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.937642 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.937732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.937856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.937961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.938174 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.938337 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.938431 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.938516 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.938712 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.939099 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.939099 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.939343 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.939498 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848938-2-iscsi {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.939618 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.939772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.939872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.939964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.940048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.940269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.940369 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.940581 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.940724 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.940883 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.940984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.941196 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.941300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.941501 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.941591 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.941810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.942005 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.942124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.942316 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.942416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.942620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.942719 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.942930 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.943037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.943266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.943366 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.943607 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.943716 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.943916 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.944018 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.944241 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.944339 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.944547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.944637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.944871 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.944970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.945178 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.945269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.945554 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.945651 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848938-2-iscsi {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.945876 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.945976 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.946186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.946283 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.946500 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.946598 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.946824 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.946925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.947142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.947239 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.947489 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.947611 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.947808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.947909 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.948125 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.948216 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.948450 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.948548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.948765 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.948861 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.949092 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.949190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.949409 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.949508 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.949731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.949822 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.950033 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.950130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.950343 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.950444 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.950651 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.950750 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.950968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.951062 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.951368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.951514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.951706 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.951805 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.951956 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.952058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.952264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.952370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.952591 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.952698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.952915 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.953007 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.953239 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.953345 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.953490 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.953633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.953722 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.953865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.954045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.954182 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.954369 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.954504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.954678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.954817 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.954986 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.955141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.955291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.955493 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.955622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.955797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.955929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.956113 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.956218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.956435 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.956530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.956744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.956843 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.957062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.957155 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.957396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.957506 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.957727 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.957828 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.958034 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.958134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.958347 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.958445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.958672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.958770 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.958978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.959076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.959284 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.959397 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.959632 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.959735 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.959944 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.960039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.960250 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.960352 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.960563 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.960653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.960879 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.961012 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.961186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.961327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.961493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.961633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.961798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.961892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.962116 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.962252 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.962432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.962539 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.962738 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.962860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.963003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.963130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.963272 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.963424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.963603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.963740 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.963922 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.964059 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.964234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.964355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.964541 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.964661 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.964844 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.964972 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.965141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.965269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.965444 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.965563 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.965750 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.965869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.966055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.966181 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.966361 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.966480 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.966664 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.967288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.967517 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.967650 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.968783 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.968935 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.969038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.969131 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.969215 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.969355 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.969445 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.969538 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.969624 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.969706 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.969788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.969877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.969961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.970056 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.970141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.970223 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.970337 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.970487 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.970653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.970792 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.970956 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.971087 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.971262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.971416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.972347 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.972483 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.972609 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.972723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.972842 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.972966 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.973067 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.973152 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.973280 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.973405 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.973558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.973649 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.973732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.973813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.973894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.973989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.974073 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.974161 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.974320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.974412 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.974686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.974910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.975002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.975254 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.975353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.975601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.975703 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.975906 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.975998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.976210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.976301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.976515 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.976606 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.976822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.976923 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.977124 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.977215 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.977442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.977765 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.977869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.978073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.978212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.978378 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.978517 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.978681 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.978785 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.979002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:06:25.979103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.979325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.979476 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.979676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.979772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.979988 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.980088 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.980311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.980403 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.980622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.980721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.980934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.981026 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.981242 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.981333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.981553 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.981648 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.981871 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.981969 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.982178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.982274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.983034 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.983136 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.983346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.983530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.983685 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.983776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.984004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.984107 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.984315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.984414 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.984625 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.984723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.984935 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.985035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.985263 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.985361 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.985582 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.985679 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.985892 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.985996 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.986212 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.986313 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.986543 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.986641 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.986867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.986959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.987178 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.987276 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.987530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.987635 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.987845 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.987939 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.988157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.988295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.988469 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.988614 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.988788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.988930 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.989103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.989202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.989413 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.989509 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.989724 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.989820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.990035 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.990131 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.990355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.990463 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.990672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.990764 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.990984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.991111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.991289 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.991503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.991628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.991775 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.991918 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.992013 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.992235 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.992336 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.992543 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.992644 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.992852 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.992943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.993167 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.993269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.993480 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.993573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.993788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.993926 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.994104 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.994249 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.994410 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.994549 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.994726 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.994828 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.995033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.995124 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.995337 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.995453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.995670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.995809 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.995976 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.996097 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.996288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.996380 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.996594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.996736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.996919 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.997048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.997237 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.997368 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.997549 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.997667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.997864 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.998212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.998526 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.998776 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.998941 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.999111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.999256 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.999464 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.999629 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.999781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:25.999926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.000078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.000221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.000362 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.000512 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.000654 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.000795 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.000953 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.001115 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.001258 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.001400 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.001678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.002038 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.002309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.002638 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.002944 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.003251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.003564 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.003717 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.003898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.004001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.004215 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.004317 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.004534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.004705 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.004863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.005026 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.005180 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.005332 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.005491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.005779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.005889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.006123 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.006221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.006448 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.006546 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.006753 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.006851 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.007079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.007179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.007438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.007558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.007743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.007851 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.008051 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.008158 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.008365 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.008499 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.008664 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.008814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.008970 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.009118 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.009273 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.009430 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.009577 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.009732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.009896 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.010044 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.010206 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.010365 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.010643 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.010798 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.010946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.011101 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.011264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.011501 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.011704 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.012812 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.012980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.013136 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.013296 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.013472 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.013778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.013778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.014103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.014103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.014393 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.014393 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.014682 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.014682 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.014969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.015173 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.015325 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.015520 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.015682 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.015843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.015990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.016145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.016301 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.016466 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.016624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.016772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.016920 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.017089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.017237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.017518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.017710 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.017901 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.018053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.018214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.018373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.018531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.018679 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.018827 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.018982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.018982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.019276 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.019490 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.019654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.019804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.019971 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.020120 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.020266 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.020413 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.020560 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.020857 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.021022 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.021316 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.021478 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.021635 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.021784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.021784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.023082 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.023265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.023493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.023650 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.023798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.023798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.024164 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.024316 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.024463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.024611 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.024765 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.025023 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.025271 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.025424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.025583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.025741 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.025897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.026059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.026059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.026348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.026503 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.026657 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.026804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.026967 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.027125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.027275 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.027466 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.027628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.027784 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.027941 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.028089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.028236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.028398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.028609 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.028772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.028929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.029077 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.029751 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.029957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.030117 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.030280 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.030430 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.030585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.030741 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.031035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.031198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.031358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.031676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.031827 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.031980 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.032369 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.032542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.033514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.033514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.033824 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.033972 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.034120 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.034276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.034424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.034581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.034729 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.034886 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.035033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.035196 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.035354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.035554 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.035841 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.036011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.036160 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.036322 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.036478 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.036628 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.036783 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.037031 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.037213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.037373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.037521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.037680 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.037827 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.037982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.038145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.038294 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.038447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.038595 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.038742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.038889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.039061 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.039219 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.039367 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.039546 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.039546 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.039843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.039843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.040297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.040447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.040594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.040594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.040939 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.041239 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.041406 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.041564 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.041711 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.041867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.042042 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.042191 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.042588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.042752 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.042929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.043829 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.044017 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.044167 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.044314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.044462 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.044608 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.044762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.045474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.045656 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.045656 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.045656 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.046078 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.046234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.046395 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.046605 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.046758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.046906 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.047053 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.047290 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.047290 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.047654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.047817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.048040 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.048274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.048528 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.048771 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.049005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.049005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.049539 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.049700 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.050123 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.050374 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.050622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.050876 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.051129 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.051553 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.051821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.052067 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.052306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.052686 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.052847 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.053016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.053167 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.054638 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.054902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.055425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.055425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.055820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.055971 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.056120 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.056267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.056428 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.056589 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.056737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.056737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.057013 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.057173 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.057329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.057329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.057621 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.057621 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.057908 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.058072 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.058229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.058385 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.058540 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.058697 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.058859 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.059023 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.059178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.059326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.059608 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.059915 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.060210 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.060375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.060556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.060720 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.060870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.061025 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.061185 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.061333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.061621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.061789 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.061948 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.062111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.062273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.062422 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.062577 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.062871 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.063021 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.063168 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.063325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.064449 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.064701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.064854 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.065003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.065150 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.065319 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.065469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.065705 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.065868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.066018 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.066176 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.066334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.066483 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.066629 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.066784 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.066940 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.067111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.067961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.068163 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.068315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.068464 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.068623 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.068781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.068929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.069087 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.069244 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.069398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.069398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.069773 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.069924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.070091 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.070382 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.070546 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.070704 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.070860 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.071016 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.071171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.071320 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.071505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.071804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.071962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.072109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.072264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.072431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.072586 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.072874 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.073041 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.073191 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.073347 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.073495 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.073641 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.073803 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.073803 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.074850 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.075009 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.075166 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.075344 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.075588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.075739 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.075886 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.076033 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.076219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.076378 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.076535 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.076683 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.076829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.076976 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.077122 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.077293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.077450 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.077609 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.077765 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.077922 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.078076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.078239 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.078398 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.078557 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.078705 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.078862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.079011 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.079257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.079257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.079600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.079750 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.079907 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.080064 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.080211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.080501 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.080660 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.080825 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.080974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.081122 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.081268 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.081430 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.081578 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.081741 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.082032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.082196 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.082353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.082509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.082672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.082823 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.082823 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.083250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.083420 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.083599 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.083762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.083912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.084059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.084955 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.085115 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.085272 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.085432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.085588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.085744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.085901 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.086049 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.086197 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.086370 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.086520 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.086675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.086832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.086989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.087151 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.087309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.087515 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.087664 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.087811 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.087959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.088124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.088282 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.088441 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.088589 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.088589 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.088877 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.089042 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.089198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.089353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.089513 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.089661 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.089814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.089971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.090121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.090288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.090446 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.090761 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.090926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.091091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.091241 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.091432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.091597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.092422 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.092601 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.092759 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.092908 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.093182 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.093354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.093503 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.093663 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.093813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.093813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.094102 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.094250 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.095168 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.095477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.095644 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.095802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.095802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.096105 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.096282 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.096431 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.096599 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.096599 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.096893 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.097056 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.097056 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.097359 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.097521 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.097683 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.097837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.098000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.098169 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.098335 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.098497 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.098658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.098811 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.098964 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.099127 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.099280 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.099461 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.099623 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.099778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.099962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.100118 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.100283 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.100437 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.100599 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.100774 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.101082 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.101253 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.101411 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.101565 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.101722 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.101884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.102048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.102202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.102356 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.102677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.102841 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.103003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.103173 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.103485 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.103648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.103819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.103984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.104152 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.104308 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.104469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.104651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.104651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.105724 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.105893 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.106049 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.106211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.106366 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.106537 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.106692 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.106861 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.107025 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.107196 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.107446 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.108133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.108317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.108487 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.108651 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.108805 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.108959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.109112 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.109274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.109485 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.109673 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.109837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.110006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.110232 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.110500 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.110762 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.111061 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.111061 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.111770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.111940 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.112117 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.112360 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.112618 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.112618 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.113288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.113690 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.113956 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.114233 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.114517 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.114730 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.114892 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.116120 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.116387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.116665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.118097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.118097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.118441 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.118619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.118779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.118942 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.119098 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.119286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.119286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.119636 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.119802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.119961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.120132 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.120288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.120442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.120614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.120785 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.120942 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.121096 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.121260 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.121446 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.121735 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.121895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.122061 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.122061 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.122364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.122540 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.122696 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.122849 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.123052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.123331 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.123597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.123907 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.124072 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.124227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.124380 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.124541 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.124711 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.124867 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.125028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.125191 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.125658 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.126283 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.126463 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.126642 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.126858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.127020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.127192 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.127359 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.127603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.127761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.127924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.128079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.128233 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.128386 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.129171 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.129410 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.129586 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.129741 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.129896 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.130066 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.130231 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.130403 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.130562 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.130717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.130878 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.131050 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.131205 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.131366 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.131553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.131739 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.132017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.132193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.132348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.132348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.132658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.132821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.132986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.132986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.133325 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.133325 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.133763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.133763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.134306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.134474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.134638 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.134791 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.134945 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.135107 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.135277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.135491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.136507 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.136689 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.136845 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.136999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.137242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.137405 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.137568 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.137724 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.137884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.138052 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.138207 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.138361 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.138523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.138723 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.138880 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.139042 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.139224 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.139415 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.139589 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.139744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.139907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.140070 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.140252 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.140559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.140723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.140895 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.141065 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.141221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.141376 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.141546 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.141701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.141855 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.142040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.142314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.142474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.142637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.142809 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.142973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.143136 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.143299 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.143538 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.144001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.144234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.144393 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.144563 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.144721 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.144883 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145039 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145201 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.145548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.147678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.147678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.147992 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.148161 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.148327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.148473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.148640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.148804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.148976 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.149162 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.149381 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.149543 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.149705 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.149868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.150031 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.150196 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.150368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.150527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.150688 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.150853 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.151018 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.151018 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.151346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.151529 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.151685 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.151857 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.152029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.152029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.152351 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.152636 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.152797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.152952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.153121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.153277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.153439 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.153610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.153785 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.154183 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.154894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.155059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.155218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.155449 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.155614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.155792 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.155950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.156124 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.156558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.157236 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.157410 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.157577 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.157734 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.157898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.158062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.158229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.158399 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.158563 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.158720 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.158889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.159049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.159237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.159450 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.159615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.159915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.160111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.160304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.160529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.160760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.160996 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.161231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.161454 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.161677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.161925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.162150 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.162374 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.162756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.162955 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.163147 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.163354 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.163600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.163820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.164321 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.164546 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.164755 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.164966 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.164966 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.165335 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.165335 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.165755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.165755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.166193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.166795 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.167565 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.167769 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.167938 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.168114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.168269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.168269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.168590 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.168756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.168912 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.169076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.169240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.169404 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.169567 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.169567 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.169936 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.170607 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.170767 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.170955 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.171113 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.171275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.171514 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.171677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.171840 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:06:26.172004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.172004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.172004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.172004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.172004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.172004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.172004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.172004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.173443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.173443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.173443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.173443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.173443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.173443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.173443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.173443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.174894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.174894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.174894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.174894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.174894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.174894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.174894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.174894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.176114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.176114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.176114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.176114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.176114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.176114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.176114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.176114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.178154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.178154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.178154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.178154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.178154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.178154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.178154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.178154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.179346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.179346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.179346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.179346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.179346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.179346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.179346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.179346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.180943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.180943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.180943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.180943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.180943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.180943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.180943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.180943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.182149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.182149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.182149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.182149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.182149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.182149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.182149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.182149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.183573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.183573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.183573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.183573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.183573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.183573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.183573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.183573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.185052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.185052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.185052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.185052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.185052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.185052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.185052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.185052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.186276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.186276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.186276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.186276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.186276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.186276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.186276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.186276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.188309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.188309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.188309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.188309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.188309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.188309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.188309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.188309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.203204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.203204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.203204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.203204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.203204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.203204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.203204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.203204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.205078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.205078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.205078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.205078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.205078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.205078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.205078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.205078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.206372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.206372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.206372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.206372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.206372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.206372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.206372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.206372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.207602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.207602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.207602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.207602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.207602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.207602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.207602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.207602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.209730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.209730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.209730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.209730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.209730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.209730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.209730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.209730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.211140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.211140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.211140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.211140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.211140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.211140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.211140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.211140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.213508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.213508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.213508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.213508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.213508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.213508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.213508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.213508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.214705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.214705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.214705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.214705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.214705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.214705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.214705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.214705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.215964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.215964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.215964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.215964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.215964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.215964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.215964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.215964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.217718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.217718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.217718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.217718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.217718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.217718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.217718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.217718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.219006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.219006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.219006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.219006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:06:26.219006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:06:26.298093 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO dbcounter [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Registered counter for database nova_api Jul 14 11:06:26.319027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_db.sqlalchemy.engines [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:06:26.325656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writer thread running {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:06:26.352335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Registered counter for database nova_api Jul 14 11:06:26.372004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:06:26.378656 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:06:26.383338 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.context [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e1441d4-0d48-4768-9ce5-52c16a7d55c5(cell1) {{(pid=117888) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:06:26.387921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:26.390074 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:26.390921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:26.392982 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:26.395040 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO dbcounter [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Registered counter for database nova_cell0 Jul 14 11:06:26.400172 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO dbcounter [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Registered counter for database nova_cell1 Jul 14 11:06:26.408615 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_db.sqlalchemy.engines [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:06:26.410486 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_db.sqlalchemy.engines [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:06:26.417032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writer thread running {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:06:26.418364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writer thread running {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:06:26.435695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.context [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e1441d4-0d48-4768-9ce5-52c16a7d55c5(cell1) {{(pid=117889) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:06:26.439791 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:26.441394 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:26.442212 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:26.444303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:26.446284 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Registered counter for database nova_cell0 Jul 14 11:06:26.450311 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Registered counter for database nova_cell1 Jul 14 11:06:26.458215 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:06:26.459989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:06:26.465889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:06:26.468063 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:06:26.565583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO dbcounter [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Registered counter for database nova_cell0 Jul 14 11:06:26.572813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_db.sqlalchemy.engines [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:06:26.577760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writer thread running {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:06:26.611571 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Registered counter for database nova_cell0 Jul 14 11:06:26.618290 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:06:26.622816 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:06:26.905602 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: WARNING keystonemiddleware.auth_token [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:06:26.913661 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: WARNING keystonemiddleware.auth_token [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:06:26.940562 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:06:26.947869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:06:27.267437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: WARNING keystonemiddleware.auth_token [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:06:27.273510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: WARNING keystonemiddleware.auth_token [None req-471a0336-b371-47ed-ab3c-c64bc0ad2a68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:06:27.280494 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c5595c19c0 pid: 117888 (default app) Jul 14 11:06:27.294093 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:06:27.300151 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-15163ec1-ef33-4f40-9d6a-ac4ed3c39f19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:06:27.306688 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c5595c19c0 pid: 117889 (default app) Jul 14 11:07:08.593474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:08.594468 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:08.595263 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:08.596119 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:09.490537 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:09.491672 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:09.492669 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:09.493532 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:10.077197 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8f761b82-ecab-439d-9ac4-062d7bfec1d5 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Action: 'create', calling method: .version_select at 0x7f579ff32ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-91720522", "metadata": {"Type": "work"}}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:10.807211 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0d7bd722-8163-4d83-8363-70ab06374100 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Action: 'create', calling method: .version_select at 0x7f579ff31c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-886549300"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:12.688637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8f761b82-ecab-439d-9ac4-062d7bfec1d5 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 4.117593 Jul 14 11:07:12.690064 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1155 bytes} [Thu Jul 14 11:07:08 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 4121 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 14 11:07:12.702751 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6943c00b-b4bf-4c65-88a5-586b4963957f tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Calling method '.version_select at 0x7f579fdf5af0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:13.106437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6943c00b-b4bf-4c65-88a5-586b4963957f tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716" status: 200 len: 351 microversion: 2.1 time: 0.408004 Jul 14 11:07:13.107027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 2/2] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:12 2022] GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716 => generated 351 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:07:13.774868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0d7bd722-8163-4d83-8363-70ab06374100 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.295304 Jul 14 11:07:13.775763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1154 bytes} [Thu Jul 14 11:07:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4298 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 11:07:13.789595 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0339de70-ee50-4aec-9cac-540d2f3a76a4 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fdf5c10>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:13.901226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0339de70-ee50-4aec-9cac-540d2f3a76a4 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e" status: 200 len: 344 microversion: 2.1 time: 0.116268 Jul 14 11:07:13.902137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 3/4] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:13 2022] GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:14.120920 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-be04f760-ac2c-4011-b14a-fcc5cdbe082a tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Calling method '.version_select at 0x7f579fdfba60>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:14.238909 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-be04f760-ac2c-4011-b14a-fcc5cdbe082a tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716" status: 200 len: 352 microversion: 2.1 time: 0.122610 Jul 14 11:07:14.240127 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 2/5] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:14 2022] GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716 => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:14.259233 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-692fc552-305b-43c0-8176-2f8b36e482d6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Calling method '.version_select at 0x7f579fe15310>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:14.441470 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-692fc552-305b-43c0-8176-2f8b36e482d6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716" status: 200 len: 352 microversion: 2.1 time: 0.116326 Jul 14 11:07:14.441470 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 4/6] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:14 2022] GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:14.442369 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-40b5ad01-a9a4-4f03-8fcc-eb411bcd2ae6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Calling method '.version_select at 0x7f579fdfbca0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:14.549925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-40b5ad01-a9a4-4f03-8fcc-eb411bcd2ae6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716" status: 202 len: 0 microversion: 2.1 time: 0.167649 Jul 14 11:07:14.550585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 3/7] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:07:14 2022] DELETE /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:07:14.559085 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3eddccee-52a8-416c-9d1d-237cc11678e9 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Calling method '.version_select at 0x7f579fe159d0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:14.686631 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3eddccee-52a8-416c-9d1d-237cc11678e9 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716" status: 200 len: 351 microversion: 2.1 time: 0.131798 Jul 14 11:07:14.687208 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 5/8] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:14 2022] GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716 => generated 351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:14.915160 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f4ae3c94-8dc4-464f-964a-ad65d65dbdad tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fe17310>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:15.010453 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f4ae3c94-8dc4-464f-964a-ad65d65dbdad tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e" status: 200 len: 344 microversion: 2.1 time: 0.100026 Jul 14 11:07:15.013022 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 4/9] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:14 2022] GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:15.254821 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f858cef2-3b3e-46fa-96d6-b6d8ae1bbd95 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579fe15af0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:15.366565 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f858cef2-3b3e-46fa-96d6-b6d8ae1bbd95 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/0713cc9d-dc78-4bc8-a63d-dbd6092b5897" status: 200 len: 351 microversion: 2.1 time: 0.117522 Jul 14 11:07:15.367367 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 6/10] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:15 2022] GET /compute/v2.1/os-volumes/0713cc9d-dc78-4bc8-a63d-dbd6092b5897 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:15.709138 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7e86fbca-4088-408e-aa81-d90cbaa23df6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Calling method '.version_select at 0x7f579fe179d0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:15.773364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-7e86fbca-4088-408e-aa81-d90cbaa23df6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] HTTP exception thrown: Volume 1b7c473f-b392-42be-b3d7-37ede0a16716 could not be found. Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7e86fbca-4088-408e-aa81-d90cbaa23df6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Request method failure captured: Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716 HTTP/1.1 Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jcq-VzMz0YH44IVn8JMGA0s6yFuE_McUQdI_K2LShMiiWH6UAnIdNWIgzxghdVgKfy_cshhNhD2fL1X-REbnNamsuLR83j7lgYI6Q4jNNtqyK6cQsyI62VVzSx5CIKaRZH_Ne_MacVg3VWvear5xhzVkECYMf2iFrPlnLR64uIQts Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: e4a8af112fa744a185f2dfe34224f554 Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesGetTestJSON-832728553 Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:07:15.778819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4a8af112fa744a185f2dfe34224f554"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4a8af112fa744a185f2dfe34224f554", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4a8af112fa744a185f2dfe34224f554"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4a8af112fa744a185f2dfe34224f554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesGetTestJSON-832728553 Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: e4a8af112fa744a185f2dfe34224f554 Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesGetTestJSON-832728553 Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesGetTestJSON-832728553-project Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: e4b3fb9e24a24db7afb30583737f1314 Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesGetTestJSON-832728553-project Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Volume 1b7c473f-b392-42be-b3d7-37ede0a16716 could not be found. Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '1b7c473f-b392-42be-b3d7-37ede0a16716'} Jul 14 11:07:15.780302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b7c473f-b392-42be-b3d7-37ede0a16716 could not be found. (HTTP 404) (Request-ID: req-9ee0548e-88a9-4364-af27-6d2f916a4f11) Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:15.781519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:15.784055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b7c473f-b392-42be-b3d7-37ede0a16716 could not be found. Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:07:15.788240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b7c473f-b392-42be-b3d7-37ede0a16716 could not be found. Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b7c473f-b392-42be-b3d7-37ede0a16716 could not be found. Jul 14 11:07:15.790024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:15.794143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7e86fbca-4088-408e-aa81-d90cbaa23df6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] Returning 404 to user: Volume 1b7c473f-b392-42be-b3d7-37ede0a16716 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:15.798250 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7e86fbca-4088-408e-aa81-d90cbaa23df6 tempest-VolumesGetTestJSON-832728553 tempest-VolumesGetTestJSON-832728553-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716" status: 404 len: 109 microversion: 2.1 time: 0.100257 Jul 14 11:07:15.800759 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 5/11] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:15 2022] GET /compute/v2.1/os-volumes/1b7c473f-b392-42be-b3d7-37ede0a16716 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:07:16.027168 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-723831a5-4fa2-4bb8-b586-594705557199 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fe154c0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:16.163797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-723831a5-4fa2-4bb8-b586-594705557199 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e" status: 200 len: 345 microversion: 2.1 time: 0.141076 Jul 14 11:07:16.171628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 7/12] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:16 2022] GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:16.178755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-942c3eef-a40c-452f-ad3c-8cf7eaa88e57 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Action: 'create', calling method: .version_select at 0x7f579fd7b310>, body: {"snapshot": {"volume_id": "56dd5c36-8d25-41d0-8b36-4c1bd202ba2e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-989265365"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:16.890520 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-942c3eef-a40c-452f-ad3c-8cf7eaa88e57 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.716980 Jul 14 11:07:16.891658 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 6/13] 10.222.0.75 () {60 vars in 1161 bytes} [Thu Jul 14 11:07:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:16.904673 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-08cf8f8d-b35c-4cd9-8345-1652335a4ef2 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fdf5ca0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:17.060193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-08cf8f8d-b35c-4cd9-8345-1652335a4ef2 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 286 microversion: 2.1 time: 0.160642 Jul 14 11:07:17.061203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 8/14] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:16 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:17.071416 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8e0002b3-4055-4cdf-a8e8-96e5f4a5ce36 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f57a0796040>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:17.164949 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8e0002b3-4055-4cdf-a8e8-96e5f4a5ce36 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.098027 Jul 14 11:07:17.165611 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 7/15] 10.222.0.75 () {58 vars in 1139 bytes} [Thu Jul 14 11:07:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:17.178021 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ef4d5f63-e45a-418f-847e-6f4cf93cd0ea tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fdf5a60>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:17.235027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ef4d5f63-e45a-418f-847e-6f4cf93cd0ea tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 286 microversion: 2.1 time: 0.062389 Jul 14 11:07:17.236096 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 9/16] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:17 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:17.488029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1c2ecb40-a891-43c4-b534-b68a0125081c tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579fd7b0d0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:17.551846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1c2ecb40-a891-43c4-b534-b68a0125081c tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/689f0df2-2232-4025-9ee3-7e029864e486" status: 200 len: 351 microversion: 2.1 time: 0.071836 Jul 14 11:07:17.553361 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 8/17] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:17 2022] GET /compute/v2.1/os-volumes/689f0df2-2232-4025-9ee3-7e029864e486 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:18.248843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c2777c2d-1d7c-403d-afa9-8f41b4fa9762 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fe153a0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:18.336905 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c2777c2d-1d7c-403d-afa9-8f41b4fa9762 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 286 microversion: 2.1 time: 0.094064 Jul 14 11:07:18.337779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 10/18] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:18 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:19.349439 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-01dbbe48-22af-4d84-9678-2db28a5b7dcf tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fd85280>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:19.443744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-01dbbe48-22af-4d84-9678-2db28a5b7dcf tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 286 microversion: 2.1 time: 0.098496 Jul 14 11:07:19.447824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 9/19] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:19 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:20.455845 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e219de0a-b6a0-4e4e-8b97-df7c644dbc8e tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fe15c10>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:20.517426 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e219de0a-b6a0-4e4e-8b97-df7c644dbc8e tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 286 microversion: 2.1 time: 0.065192 Jul 14 11:07:20.521955 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 11/20] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:20 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:21.530252 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ecda70ee-ae56-4ed8-a508-f44b2411dbd6 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fe27280>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:21.597464 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ecda70ee-ae56-4ed8-a508-f44b2411dbd6 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 286 microversion: 2.1 time: 0.072567 Jul 14 11:07:21.598556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 12/21] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:21 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:21.781389 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc3f86db-e073-4143-9d1d-d6008262d9d1 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Action: 'create', calling method: .version_select at 0x7f579fd7bf70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1555177936", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc3f86db-e073-4143-9d1d-d6008262d9d1 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Request method failure captured: Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 122 Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_joVo1GNg3mvk4VGj6zQy74KX5Ch8VG6t8xBCTM7a82w8K8s3cTbT17ydPSBd-IECTFm3_Xs3ngrlJgX-ghaUtijEfeuildBtl-riEjcHowJj6V_wdg3P-zk219lYReHLygrdSUKmWk_9VnJv_dxXW8xkHeu6N1ITVlU9G5ApdNTgE Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:07:21.801597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8362e5675331424982c4e018bbfea642"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8362e5675331424982c4e018bbfea642", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 02ee4a7254e9460f8169c412de8bbcb5 Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1555177936", "metadata": {"Type": "work"}}} Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: Jul 14 11:07:21.802907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1555177936', 'metadata': {'Type': 'work'}}}} Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:21.803870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:07:21.805458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:07:21.806957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:07:21.806957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.806957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc3f86db-e073-4143-9d1d-d6008262d9d1 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:21.806957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bc3f86db-e073-4143-9d1d-d6008262d9d1 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.708285 Jul 14 11:07:21.814763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cbf44af7-11a0-403d-8a78-8c227be6f4de tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Action: 'create', calling method: .version_select at 0x7f579fe15d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-15015645", "metadata": {"Type": "work"}}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:21.816668 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 10/22] 10.222.0.75 () {60 vars in 1155 bytes} [Thu Jul 14 11:07:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 721 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cbf44af7-11a0-403d-8a78-8c227be6f4de tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Request method failure captured: Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 118 Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_joVo1GNg3mvk4VGj6zQy74KX5Ch8VG6t8xBCTM7a82w8K8s3cTbT17ydPSBd-IECTFm3_Xs3ngrlJgX-ghaUtijEfeuildBtl-riEjcHowJj6V_wdg3P-zk219lYReHLygrdSUKmWk_9VnJv_dxXW8xkHeu6N1ITVlU9G5ApdNTgE Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:07:21.819214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8362e5675331424982c4e018bbfea642"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8362e5675331424982c4e018bbfea642", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 02ee4a7254e9460f8169c412de8bbcb5 Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-15015645", "metadata": {"Type": "work"}}} Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: Jul 14 11:07:21.820370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-15015645', 'metadata': {'Type': 'work'}}}} Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi '0' Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:21.820970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:07:21.821917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:07:21.822761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:07:21.822761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.826528 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cbf44af7-11a0-403d-8a78-8c227be6f4de tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:21.827848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cbf44af7-11a0-403d-8a78-8c227be6f4de tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016845 Jul 14 11:07:21.830871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 13/23] 10.222.0.75 () {60 vars in 1155 bytes} [Thu Jul 14 11:07:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:07:21.845949 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb9dd9a2-fc18-489f-bf03-9e7291a84c8d tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Action: 'create', calling method: .version_select at 0x7f57a07dce50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-352606898", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb9dd9a2-fc18-489f-bf03-9e7291a84c8d tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Request method failure captured: Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 118 Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_joVo1GNg3mvk4VGj6zQy74KX5Ch8VG6t8xBCTM7a82w8K8s3cTbT17ydPSBd-IECTFm3_Xs3ngrlJgX-ghaUtijEfeuildBtl-riEjcHowJj6V_wdg3P-zk219lYReHLygrdSUKmWk_9VnJv_dxXW8xkHeu6N1ITVlU9G5ApdNTgE Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:07:21.861547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8362e5675331424982c4e018bbfea642"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8362e5675331424982c4e018bbfea642", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 02ee4a7254e9460f8169c412de8bbcb5 Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-352606898", "metadata": {"Type": "work"}}} Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: Jul 14 11:07:21.862619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-352606898', 'metadata': {'Type': 'work'}}}} Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi '' Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:21.863195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:07:21.864203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:07:21.865043 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:07:21.865043 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.865043 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb9dd9a2-fc18-489f-bf03-9e7291a84c8d tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:21.865043 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb9dd9a2-fc18-489f-bf03-9e7291a84c8d tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025969 Jul 14 11:07:21.865846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 11/24] 10.222.0.75 () {60 vars in 1155 bytes} [Thu Jul 14 11:07:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:07:21.876832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-483216bf-3a2e-42d8-b04c-b9a9f56a28e9 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Calling method '.version_select at 0x7f579fe273a0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:21.960317 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-483216bf-3a2e-42d8-b04c-b9a9f56a28e9 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] HTTP exception thrown: Volume tempest-invalid-1685119219 could not be found. Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-483216bf-3a2e-42d8-b04c-b9a9f56a28e9 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Request method failure captured: Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1685119219 HTTP/1.1 Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_joVo1GNg3mvk4VGj6zQy74KX5Ch8VG6t8xBCTM7a82w8K8s3cTbT17ydPSBd-IECTFm3_Xs3ngrlJgX-ghaUtijEfeuildBtl-riEjcHowJj6V_wdg3P-zk219lYReHLygrdSUKmWk_9VnJv_dxXW8xkHeu6N1ITVlU9G5ApdNTgE Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:07:21.963918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8362e5675331424982c4e018bbfea642"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8362e5675331424982c4e018bbfea642", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 02ee4a7254e9460f8169c412de8bbcb5 Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Volume tempest-invalid-1685119219 could not be found. Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'tempest-invalid-1685119219'} Jul 14 11:07:21.965604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1685119219 could not be found. (HTTP 404) (Request-ID: req-2ddab047-76e3-43fa-b704-3e35d5e2378f) Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.966187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:07:21.975114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1685119219 could not be found. Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:21.977547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1685119219 could not be found. Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1685119219 could not be found. Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-483216bf-3a2e-42d8-b04c-b9a9f56a28e9 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Returning 404 to user: Volume tempest-invalid-1685119219 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-483216bf-3a2e-42d8-b04c-b9a9f56a28e9 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1685119219" status: 404 len: 99 microversion: 2.1 time: 0.093392 Jul 14 11:07:21.979973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 14/25] 10.222.0.75 () {58 vars in 1217 bytes} [Thu Jul 14 11:07:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1685119219 => generated 99 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:07:21.988273 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8819b2d6-0f15-426f-94c1-6720a4236bbc tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003959 Jul 14 11:07:22.000739 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-efd3dbc8-0c94-423f-bb7a-01b6e82b7dcd tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004612 Jul 14 11:07:22.001582 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 15/26] 10.222.0.75 () {58 vars in 1136 bytes} [Thu Jul 14 11:07:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 11:07:22.002077 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 12/27] 10.222.0.75 () {58 vars in 1139 bytes} [Thu Jul 14 11:07:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 11:07:22.014455 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9e7c7251-b536-4f6e-80da-67592e0f3603 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Calling method '.version_select at 0x7f579fe27940>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:22.077162 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-9e7c7251-b536-4f6e-80da-67592e0f3603 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] HTTP exception thrown: Volume 64a87e92-0cc3-4624-a3a2-5d24b4c55df4 could not be found. Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9e7c7251-b536-4f6e-80da-67592e0f3603 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Request method failure captured: Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/os-volumes/64a87e92-0cc3-4624-a3a2-5d24b4c55df4 HTTP/1.1 Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_joVo1GNg3mvk4VGj6zQy74KX5Ch8VG6t8xBCTM7a82w8K8s3cTbT17ydPSBd-IECTFm3_Xs3ngrlJgX-ghaUtijEfeuildBtl-riEjcHowJj6V_wdg3P-zk219lYReHLygrdSUKmWk_9VnJv_dxXW8xkHeu6N1ITVlU9G5ApdNTgE Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:07:22.080348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8362e5675331424982c4e018bbfea642"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8362e5675331424982c4e018bbfea642", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 02ee4a7254e9460f8169c412de8bbcb5 Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Volume 64a87e92-0cc3-4624-a3a2-5d24b4c55df4 could not be found. Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '64a87e92-0cc3-4624-a3a2-5d24b4c55df4'} Jul 14 11:07:22.081434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64a87e92-0cc3-4624-a3a2-5d24b4c55df4 could not be found. (HTTP 404) (Request-ID: req-e140d26c-0bbb-4b49-a319-5955d49bb57b) Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:22.082027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:07:22.083049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64a87e92-0cc3-4624-a3a2-5d24b4c55df4 could not be found. Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:07:22.085171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64a87e92-0cc3-4624-a3a2-5d24b4c55df4 could not be found. Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64a87e92-0cc3-4624-a3a2-5d24b4c55df4 could not be found. Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9e7c7251-b536-4f6e-80da-67592e0f3603 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Returning 404 to user: Volume 64a87e92-0cc3-4624-a3a2-5d24b4c55df4 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9e7c7251-b536-4f6e-80da-67592e0f3603 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/64a87e92-0cc3-4624-a3a2-5d24b4c55df4" status: 404 len: 109 microversion: 2.1 time: 0.071867 Jul 14 11:07:22.087180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 16/28] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:07:22 2022] DELETE /compute/v2.1/os-volumes/64a87e92-0cc3-4624-a3a2-5d24b4c55df4 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:22.097141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7698038d-f223-49c2-a0ec-588ce4686f76 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Calling method '.version_select at 0x7f579fd7b550>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:22.141836 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-7698038d-f223-49c2-a0ec-588ce4686f76 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] HTTP exception thrown: Volume 68533143-1751-49d8-b284-5114d939feed could not be found. Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7698038d-f223-49c2-a0ec-588ce4686f76 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Request method failure captured: Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-volumes/68533143-1751-49d8-b284-5114d939feed HTTP/1.1 Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_joVo1GNg3mvk4VGj6zQy74KX5Ch8VG6t8xBCTM7a82w8K8s3cTbT17ydPSBd-IECTFm3_Xs3ngrlJgX-ghaUtijEfeuildBtl-riEjcHowJj6V_wdg3P-zk219lYReHLygrdSUKmWk_9VnJv_dxXW8xkHeu6N1ITVlU9G5ApdNTgE Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:07:22.144098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8362e5675331424982c4e018bbfea642"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8362e5675331424982c4e018bbfea642", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8362e5675331424982c4e018bbfea642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 8362e5675331424982c4e018bbfea642 Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-363100009 Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 02ee4a7254e9460f8169c412de8bbcb5 Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-363100009-project Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Volume 68533143-1751-49d8-b284-5114d939feed could not be found. Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '68533143-1751-49d8-b284-5114d939feed'} Jul 14 11:07:22.145091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68533143-1751-49d8-b284-5114d939feed could not be found. (HTTP 404) (Request-ID: req-e733d939-e683-487b-a931-b80f992d6ed3) Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:22.145675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:22.146536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68533143-1751-49d8-b284-5114d939feed could not be found. Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:07:22.147375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68533143-1751-49d8-b284-5114d939feed could not be found. Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68533143-1751-49d8-b284-5114d939feed could not be found. Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7698038d-f223-49c2-a0ec-588ce4686f76 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] Returning 404 to user: Volume 68533143-1751-49d8-b284-5114d939feed could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:22.148229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7698038d-f223-49c2-a0ec-588ce4686f76 tempest-VolumesNegativeTest-363100009 tempest-VolumesNegativeTest-363100009-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/68533143-1751-49d8-b284-5114d939feed" status: 404 len: 109 microversion: 2.1 time: 0.057942 Jul 14 11:07:22.150082 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 13/29] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:22 2022] GET /compute/v2.1/os-volumes/68533143-1751-49d8-b284-5114d939feed => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:22.610914 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-759fbbb1-c2e9-4dd5-853d-9fba05aadb95 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fe27c10>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:22.681681 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-759fbbb1-c2e9-4dd5-853d-9fba05aadb95 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 286 microversion: 2.1 time: 0.074705 Jul 14 11:07:22.682814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 17/30] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:22 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:23.694730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d7c84b16-67cd-4f13-8066-4b9b0fae8f71 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fd7b310>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:23.756265 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d7c84b16-67cd-4f13-8066-4b9b0fae8f71 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 287 microversion: 2.1 time: 0.065578 Jul 14 11:07:23.757037 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 14/31] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:23 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:23.777262 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3414fb00-2d0b-4af1-bb32-2c8261f7e839 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fe27550>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:23.926065 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3414fb00-2d0b-4af1-bb32-2c8261f7e839 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 202 len: 0 microversion: 2.1 time: 0.161703 Jul 14 11:07:23.929469 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 18/32] 10.222.0.75 () {58 vars in 1253 bytes} [Thu Jul 14 11:07:23 2022] DELETE /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:07:23.936235 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9f95d8ba-72e1-4ec7-8a85-62c39810760c tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f57a065c790>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:23.982006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9f95d8ba-72e1-4ec7-8a85-62c39810760c tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 200 len: 286 microversion: 2.1 time: 0.050919 Jul 14 11:07:23.982940 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 15/33] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:23 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:24.960784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4fc18dbd-be4d-4d0b-909b-502968c780f9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: .version_select at 0x7f579fe0c3a0>, body: {"keypair": {"name": "tempest-keypair-688231624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOaTSmDULCbQ5ySN+tu1OZsdHu91F9e0Eojz8vrLu8tuiMOavBQ7z0qpV1mvd33UH1ncmAfdzfvLySb/TtG3cEs5lSglNTZfo8NR5yrCUDMm1U4+1E1kBvN80ZXN1W9aw=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:24.983098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d89c0dd4-5dcc-4dfe-b2b8-b0c69d0e4e85 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579fd7b1f0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.080986 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d89c0dd4-5dcc-4dfe-b2b8-b0c69d0e4e85 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/e396e51f-4b77-4d23-a623-fdcea47a6f7a" status: 200 len: 351 microversion: 2.1 time: 0.101736 Jul 14 11:07:25.088173 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 16/34] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:24 2022] GET /compute/v2.1/os-volumes/e396e51f-4b77-4d23-a623-fdcea47a6f7a => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:25.088173 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-60f0df66-ab3b-47ed-b3e6-742231a0f988 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f57a07dcee0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.125543 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-4fc18dbd-be4d-4d0b-909b-502968c780f9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for project 7f04452d94114c64b9882cfa66e29479. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:07:25.134827 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-60f0df66-ab3b-47ed-b3e6-742231a0f988 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] HTTP exception thrown: Snapshot ebe22710-4eac-408f-8f75-b02e54ef1002 could not be found. Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-60f0df66-ab3b-47ed-b3e6-742231a0f988 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Request method failure captured: Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 HTTP/1.1 Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jdGK8YrhCgbHNhhzg0QOmzccUI7ngQkwslyQd8yVABg333tefEvvZwcEsTPCRb0K14ZeGbKu6iXtaDWbnTY-UocrZ5SMl9ROLgyrEU8i3sq3KgCm5Ls6-kBVzL-Givdye2jl0MK31RpOg641v3Un-h7Em3COonM7f7x1JZHwQPsH4 Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 88118eaad2474baa9a9039d13a705efe Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:07:25.138098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_88118eaad2474baa9a9039d13a705efe", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 88118eaad2474baa9a9039d13a705efe Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotsTestJSON-513407796-project Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 0b4caa892c3c4a3fb9ee06e6870f7160 Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotsTestJSON-513407796-project Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Snapshot ebe22710-4eac-408f-8f75-b02e54ef1002 could not be found. Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'ebe22710-4eac-408f-8f75-b02e54ef1002'} Jul 14 11:07:25.139242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ebe22710-4eac-408f-8f75-b02e54ef1002 could not be found. (HTTP 404) (Request-ID: req-33b47e0b-96ed-4e6a-8e8e-48095b95be6a) Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:25.139961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:25.140839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ebe22710-4eac-408f-8f75-b02e54ef1002 could not be found. Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 11:07:25.141715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ebe22710-4eac-408f-8f75-b02e54ef1002 could not be found. Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ebe22710-4eac-408f-8f75-b02e54ef1002 could not be found. Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-60f0df66-ab3b-47ed-b3e6-742231a0f988 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Returning 404 to user: Snapshot ebe22710-4eac-408f-8f75-b02e54ef1002 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-60f0df66-ab3b-47ed-b3e6-742231a0f988 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002" status: 404 len: 111 microversion: 2.1 time: 0.056305 Jul 14 11:07:25.142653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 17/35] 10.222.0.75 () {58 vars in 1250 bytes} [Thu Jul 14 11:07:25 2022] GET /compute/v2.1/os-snapshots/ebe22710-4eac-408f-8f75-b02e54ef1002 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:25.152466 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-55ef45e4-781a-4e58-b549-ef663cf6c136 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579fd7b160>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.154417 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-4fc18dbd-be4d-4d0b-909b-502968c780f9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for user fffbf852ddc9455f8a68f80ad118e4d1 and project 7f04452d94114c64b9882cfa66e29479. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:07:25.289141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4fc18dbd-be4d-4d0b-909b-502968c780f9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.606136 Jul 14 11:07:25.291217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 19/36] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:07:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:25.301062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4b0c0e4e-0651-4a2c-b9bf-1108d9e8e3d1 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fcfcc10>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.386276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-55ef45e4-781a-4e58-b549-ef663cf6c136 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.241987 Jul 14 11:07:25.387075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 18/37] 10.222.0.75 () {58 vars in 1133 bytes} [Thu Jul 14 11:07:25 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:25.403635 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cffa1aa1-1901-4a72-b6b4-63a5a3f6f3fa tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579fe18160>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.518514 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4b0c0e4e-0651-4a2c-b9bf-1108d9e8e3d1 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e" status: 202 len: 0 microversion: 2.1 time: 0.225879 Jul 14 11:07:25.519593 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 20/38] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:07:25 2022] DELETE /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:07:25.527963 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d1612e64-1181-45c5-8dbf-e8f7da6c4ea9 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579f4b41f0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.639709 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cffa1aa1-1901-4a72-b6b4-63a5a3f6f3fa tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.242624 Jul 14 11:07:25.641932 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 19/39] 10.222.0.75 () {58 vars in 1148 bytes} [Thu Jul 14 11:07:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:25.654362 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-50052900-ac2f-4106-839c-273345db4e39 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579fe18f70>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.869372 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d1612e64-1181-45c5-8dbf-e8f7da6c4ea9 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e" status: 200 len: 344 microversion: 2.1 time: 0.345407 Jul 14 11:07:25.870091 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 21/40] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:25 2022] GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e => generated 344 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:07:26.073492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-50052900-ac2f-4106-839c-273345db4e39 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.423079 Jul 14 11:07:26.074417 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 20/41] 10.222.0.75 () {58 vars in 1133 bytes} [Thu Jul 14 11:07:25 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:07:26.088389 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2658d720-639e-4bbe-8980-ec0f50f67d15 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579f4b4820>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:26.313836 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2658d720-639e-4bbe-8980-ec0f50f67d15 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.229943 Jul 14 11:07:26.314917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 22/42] 10.222.0.75 () {58 vars in 1166 bytes} [Thu Jul 14 11:07:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:26.327362 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7f5cbeca-ba6f-4077-b323-fbcd8a46b842 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579fe18790>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:26.696427 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7f5cbeca-ba6f-4077-b323-fbcd8a46b842 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.373605 Jul 14 11:07:26.697605 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 21/43] 10.222.0.75 () {58 vars in 1169 bytes} [Thu Jul 14 11:07:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:26.709685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-21419923-5c07-4412-aba9-da44b16802e7 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579fcfcb80>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:26.882087 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4e2a9101-ad6e-49d3-85ea-d6172d93f29a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fd7bd30>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:26.946962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-21419923-5c07-4412-aba9-da44b16802e7 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.241068 Jul 14 11:07:26.953955 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 23/44] 10.222.0.75 () {58 vars in 1154 bytes} [Thu Jul 14 11:07:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:26.959183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ce398ff7-df0c-442a-b8c9-7e8b68d3a754 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579f4b45e0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:27.019155 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-4e2a9101-ad6e-49d3-85ea-d6172d93f29a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] HTTP exception thrown: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4e2a9101-ad6e-49d3-85ea-d6172d93f29a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Request method failure captured: Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e HTTP/1.1 Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jdGK8YrhCgbHNhhzg0QOmzccUI7ngQkwslyQd8yVABg333tefEvvZwcEsTPCRb0K14ZeGbKu6iXtaDWbnTY-UocrZ5SMl9ROLgyrEU8i3sq3KgCm5Ls6-kBVzL-Givdye2jl0MK31RpOg641v3Un-h7Em3COonM7f7x1JZHwQPsH4 Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 88118eaad2474baa9a9039d13a705efe Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:07:27.021980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_88118eaad2474baa9a9039d13a705efe", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 88118eaad2474baa9a9039d13a705efe Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotsTestJSON-513407796-project Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 0b4caa892c3c4a3fb9ee06e6870f7160 Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotsTestJSON-513407796-project Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '56dd5c36-8d25-41d0-8b36-4c1bd202ba2e'} Jul 14 11:07:27.023048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. (HTTP 404) (Request-ID: req-cf9e9ff7-ed20-40b5-aa9d-96f40435d4f1) Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.023773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:27.024642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:07:27.025592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.026581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.028852 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4e2a9101-ad6e-49d3-85ea-d6172d93f29a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Returning 404 to user: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:27.029849 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4e2a9101-ad6e-49d3-85ea-d6172d93f29a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e" status: 404 len: 109 microversion: 2.1 time: 0.151749 Jul 14 11:07:27.030882 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 22/45] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:26 2022] GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:27.047969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f224d6e1-023f-448b-b119-0c6114feb892 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fd7b9d0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:27.231320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ce398ff7-df0c-442a-b8c9-7e8b68d3a754 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.275933 Jul 14 11:07:27.232244 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 24/46] 10.222.0.75 () {58 vars in 1187 bytes} [Thu Jul 14 11:07:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:27.243306 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ca9bdf0e-2893-4ece-9562-bc4e2ed60fe8 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] Calling method '.version_select at 0x7f579f4bc4c0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:27.289501 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-f224d6e1-023f-448b-b119-0c6114feb892 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] HTTP exception thrown: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f224d6e1-023f-448b-b119-0c6114feb892 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Request method failure captured: Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e HTTP/1.1 Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jdGK8YrhCgbHNhhzg0QOmzccUI7ngQkwslyQd8yVABg333tefEvvZwcEsTPCRb0K14ZeGbKu6iXtaDWbnTY-UocrZ5SMl9ROLgyrEU8i3sq3KgCm5Ls6-kBVzL-Givdye2jl0MK31RpOg641v3Un-h7Em3COonM7f7x1JZHwQPsH4 Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 88118eaad2474baa9a9039d13a705efe Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:07:27.291411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_88118eaad2474baa9a9039d13a705efe", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 88118eaad2474baa9a9039d13a705efe Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotsTestJSON-513407796-project Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 0b4caa892c3c4a3fb9ee06e6870f7160 Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotsTestJSON-513407796-project Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '56dd5c36-8d25-41d0-8b36-4c1bd202ba2e'} Jul 14 11:07:27.292424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. (HTTP 404) (Request-ID: req-12a21278-9c1c-4865-bb0f-de9d11b217fc) Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.293324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:07:27.294209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:07:27.295174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f224d6e1-023f-448b-b119-0c6114feb892 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Returning 404 to user: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f224d6e1-023f-448b-b119-0c6114feb892 tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e" status: 404 len: 109 microversion: 2.1 time: 0.249395 Jul 14 11:07:27.296264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 23/47] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:07:27 2022] DELETE /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e => generated 109 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:07:27.304225 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-68663980-2aff-4b34-a63f-6c63ea7bc33a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Calling method '.version_select at 0x7f579fe189d0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:27.598176 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ca9bdf0e-2893-4ece-9562-bc4e2ed60fe8 tempest-VolumesTestJSON-144506412 tempest-VolumesTestJSON-144506412-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.358479 Jul 14 11:07:27.598752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 25/48] 10.222.0.75 () {58 vars in 1154 bytes} [Thu Jul 14 11:07:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:07:27.711781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-68663980-2aff-4b34-a63f-6c63ea7bc33a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] HTTP exception thrown: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-68663980-2aff-4b34-a63f-6c63ea7bc33a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Request method failure captured: Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e HTTP/1.1 Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jdGK8YrhCgbHNhhzg0QOmzccUI7ngQkwslyQd8yVABg333tefEvvZwcEsTPCRb0K14ZeGbKu6iXtaDWbnTY-UocrZ5SMl9ROLgyrEU8i3sq3KgCm5Ls6-kBVzL-Givdye2jl0MK31RpOg641v3Un-h7Em3COonM7f7x1JZHwQPsH4 Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 88118eaad2474baa9a9039d13a705efe Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:07:27.713746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_88118eaad2474baa9a9039d13a705efe", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/88118eaad2474baa9a9039d13a705efe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 88118eaad2474baa9a9039d13a705efe Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-513407796 Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotsTestJSON-513407796-project Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 0b4caa892c3c4a3fb9ee06e6870f7160 Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotsTestJSON-513407796-project Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '56dd5c36-8d25-41d0-8b36-4c1bd202ba2e'} Jul 14 11:07:27.715142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. (HTTP 404) (Request-ID: req-89d45e7c-3198-481b-9bfe-21c633a38595) Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.716069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:07:27.717113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:07:27.718237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-68663980-2aff-4b34-a63f-6c63ea7bc33a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] Returning 404 to user: Volume 56dd5c36-8d25-41d0-8b36-4c1bd202ba2e could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:27.719300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-68663980-2aff-4b34-a63f-6c63ea7bc33a tempest-VolumesSnapshotsTestJSON-513407796 tempest-VolumesSnapshotsTestJSON-513407796-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e" status: 404 len: 109 microversion: 2.1 time: 0.418032 Jul 14 11:07:27.722944 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 24/49] 10.222.0.75 () {58 vars in 1244 bytes} [Thu Jul 14 11:07:27 2022] GET /compute/v2.1/os-volumes/56dd5c36-8d25-41d0-8b36-4c1bd202ba2e => generated 109 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:28.902996 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2028867989", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "networks": [{"uuid": "6b59ebe6-7c6e-4831-8fc8-b7d332f14328"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:29.058117 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] validate_networks() for [('6b59ebe6-7c6e-4831-8fc8-b7d332f14328', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:07:29.949457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-75c06751-5d8f-48fa-b1fe-f02d139f217c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'create', calling method: .version_select at 0x7f579fd7bb80>, body: {"keypair": {"name": "tempest-keypair-1080411651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFNhX6uJP4Zxpqa/I+XI77CuxoEYWBVLJgjWe8yXkBDhPnr2VdZeij5zD4dWVJigd6SvXLifKTs91PBo6HeW6bSXnfnZqWyExAIgsuM+t9wdNAV0AUFFled6Zt5U8izvA=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:30.096645 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-75c06751-5d8f-48fa-b1fe-f02d139f217c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Getting quotas for project 9b56ea0be2964e21985deb5964232923. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:07:30.129470 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-75c06751-5d8f-48fa-b1fe-f02d139f217c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Getting quotas for user bf3817e18de149aba43a2f65f37d63f4 and project 9b56ea0be2964e21985deb5964232923. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:07:30.229474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-75c06751-5d8f-48fa-b1fe-f02d139f217c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.606986 Jul 14 11:07:30.230592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 25/50] 10.222.0.75 () {62 vars in 1199 bytes} [Thu Jul 14 11:07:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 610 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 11:07:31.836930 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:07:31.837356 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:07:31.850714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:07:31.851309 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:07:31.851830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:07:31.868517 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:31.869230 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:31.870250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:31.871512 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:31.898372 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Getting quotas for project a90a870ee4154287be1282b3f46bdd05. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:07:31.904087 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Getting quotas for user f330cdfd7d2b47a985d8dc76c19da9a4 and project a90a870ee4154287be1282b3f46bdd05. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:07:31.917057 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:07:31.920972 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:07:32.094063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eefc0eff-d4a8-43d1-82ee-a8b157125984 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.568684 Jul 14 11:07:32.095794 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 26/51] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:07:32.106315 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e7ee0059-89c3-4cbc-a967-f4294b72e014 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:32.107638 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e7ee0059-89c3-4cbc-a967-f4294b72e014 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:32.436069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e7ee0059-89c3-4cbc-a967-f4294b72e014 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:32.474412 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e7ee0059-89c3-4cbc-a967-f4294b72e014 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1215 microversion: 2.1 time: 0.367793 Jul 14 11:07:32.478645 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 26/52] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:32 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1215 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:33.341379 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2092927363", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:33.496257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3ea8ec0f-5309-45c9-935e-ba6d1bdc5caa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:33.497503 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3ea8ec0f-5309-45c9-935e-ba6d1bdc5caa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:33.556841 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] validate_networks() for [('131ff080-99aa-4954-b49d-b15b1af99faa', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:07:34.192604 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3ea8ec0f-5309-45c9-935e-ba6d1bdc5caa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:34.202929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3ea8ec0f-5309-45c9-935e-ba6d1bdc5caa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1215 microversion: 2.1 time: 0.711372 Jul 14 11:07:34.205896 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 27/53] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:33 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1215 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:34.238312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-569118096", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e745ada-d5b0-42ea-a509-ecc280f4f780"}], "security_groups": [{"name": "tempest-securitygroup--1180999314"}], "key_name": "tempest-keypair-688231624", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:34.842433 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] validate_networks() for [('9e745ada-d5b0-42ea-a509-ecc280f4f780', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:07:35.010457 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:07:35.011128 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:07:35.012294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:07:35.012795 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:07:35.013416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:07:35.039953 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:35.041665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:35.049756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:35.050231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:35.169175 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Getting quotas for project b3f043134a3d4369983f36769d2ae197. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:07:35.187947 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Getting quotas for user cb80e0c64c3348cfac5ad2c4f82fb606 and project b3f043134a3d4369983f36769d2ae197. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:07:35.266054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:07:35.271935 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:07:35.530592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1fd21494-c36d-4803-882a-e5259734ba0e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.922727 Jul 14 11:07:35.534437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 27/54] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:07:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:07:35.577103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b1c05edc-5cff-44ee-adf6-b84a5cc0176e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:35.585264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b1c05edc-5cff-44ee-adf6-b84a5cc0176e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:35.921594 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b1c05edc-5cff-44ee-adf6-b84a5cc0176e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:35.968554 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b1c05edc-5cff-44ee-adf6-b84a5cc0176e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1215 microversion: 2.1 time: 0.417916 Jul 14 11:07:35.972524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 28/55] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:35 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1215 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:36.009753 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-90a1ce37-a9e7-417d-9422-257e60687897 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:36.019017 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-90a1ce37-a9e7-417d-9422-257e60687897 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:36.268748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-90a1ce37-a9e7-417d-9422-257e60687897 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:36.275960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-90a1ce37-a9e7-417d-9422-257e60687897 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1222 microversion: 2.1 time: 0.302173 Jul 14 11:07:36.283406 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 29/56] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:35 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1222 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:36.968510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-836593221", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:37.101022 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] validate_networks() for [('131ff080-99aa-4954-b49d-b15b1af99faa', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:07:38.177365 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:07:38.177929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:07:38.178302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:07:38.178963 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:07:38.179391 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:07:38.219479 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:38.225556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:38.233197 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:38.234124 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:38.344846 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:07:38.346075 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:07:38.347600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:07:38.348290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:07:38.349120 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:07:38.350414 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for project 7f04452d94114c64b9882cfa66e29479. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:07:38.358733 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for user fffbf852ddc9455f8a68f80ad118e4d1 and project 7f04452d94114c64b9882cfa66e29479. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:07:38.376798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:07:38.380603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:07:38.398124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:38.401157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:38.403119 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:38.406701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:38.469362 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Getting quotas for project b3f043134a3d4369983f36769d2ae197. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:07:38.477649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Getting quotas for user cb80e0c64c3348cfac5ad2c4f82fb606 and project b3f043134a3d4369983f36769d2ae197. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:07:38.501035 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:07:38.506494 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:07:38.522959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bd955089-ef44-49f0-a730-4c3d81a94f3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.315506 Jul 14 11:07:38.532720 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 28/57] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:07:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 4326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:07:38.560956 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3532c43e-86de-4f1f-a0c4-7fedcc5af6ab tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:38.562004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3532c43e-86de-4f1f-a0c4-7fedcc5af6ab tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:38.593059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3532c43e-86de-4f1f-a0c4-7fedcc5af6ab tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:38.594693 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3532c43e-86de-4f1f-a0c4-7fedcc5af6ab tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:38.616497 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3532c43e-86de-4f1f-a0c4-7fedcc5af6ab tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:38.618535 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3532c43e-86de-4f1f-a0c4-7fedcc5af6ab tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:38.620001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4fd28309-8e31-4e77-a570-cc50762cfe3f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.656558 Jul 14 11:07:38.622302 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 30/58] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:07:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:07:38.645866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-882893500", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90ec2180-c51d-4c74-aa35-68c20d17fb42"}], "security_groups": [{"name": "tempest-securitygroup--626675465"}], "key_name": "tempest-keypair-1080411651", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:39.035507 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] validate_networks() for [('90ec2180-c51d-4c74-aa35-68c20d17fb42', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:07:39.380923 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3532c43e-86de-4f1f-a0c4-7fedcc5af6ab tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:39.428410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3532c43e-86de-4f1f-a0c4-7fedcc5af6ab tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1275 microversion: 2.1 time: 0.893857 Jul 14 11:07:39.434589 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 29/59] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:38 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1275 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:39.443067 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-db2acd76-2e7d-4bc9-9059-d5229b37476e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:39.444057 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db2acd76-2e7d-4bc9-9059-d5229b37476e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:39.543732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db2acd76-2e7d-4bc9-9059-d5229b37476e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:39.555307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-db2acd76-2e7d-4bc9-9059-d5229b37476e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1240 microversion: 2.1 time: 0.117450 Jul 14 11:07:39.558560 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 30/60] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:39 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:39.570088 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7607b63e-6d6e-45ce-8d92-42ad6d7b6257 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:39.571011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7607b63e-6d6e-45ce-8d92-42ad6d7b6257 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:39.589027 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7607b63e-6d6e-45ce-8d92-42ad6d7b6257 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:39.600351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7607b63e-6d6e-45ce-8d92-42ad6d7b6257 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:39.601454 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7607b63e-6d6e-45ce-8d92-42ad6d7b6257 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:39.602053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7607b63e-6d6e-45ce-8d92-42ad6d7b6257 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:39.674840 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7607b63e-6d6e-45ce-8d92-42ad6d7b6257 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:39.684314 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7607b63e-6d6e-45ce-8d92-42ad6d7b6257 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1225 microversion: 2.1 time: 0.124586 Jul 14 11:07:39.685415 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 31/61] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:39 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:39.996294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:07:39.996738 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:07:39.997086 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:07:39.997701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:07:39.998247 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:07:40.010439 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.011332 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.012489 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.013289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.033934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Getting quotas for project 9b56ea0be2964e21985deb5964232923. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:07:40.038934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Getting quotas for user bf3817e18de149aba43a2f65f37d63f4 and project 9b56ea0be2964e21985deb5964232923. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:07:40.053759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:07:40.056542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:07:40.162804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5c00c445-0c6b-4ee3-a958-07355b644ee3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.537949 Jul 14 11:07:40.163880 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 31/62] 10.222.0.75 () {62 vars in 1187 bytes} [Thu Jul 14 11:07:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 11:07:40.177127 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e5a6f186-97c2-4340-ba07-293dd35f9d58 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:40.177799 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e5a6f186-97c2-4340-ba07-293dd35f9d58 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:40.371658 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e5a6f186-97c2-4340-ba07-293dd35f9d58 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:40.380870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e5a6f186-97c2-4340-ba07-293dd35f9d58 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:40.382822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e5a6f186-97c2-4340-ba07-293dd35f9d58 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:40.384142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e5a6f186-97c2-4340-ba07-293dd35f9d58 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1281 microversion: 2.20 time: 0.211952 Jul 14 11:07:40.384933 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 32/63] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:40 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:07:40.456933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-666ec8c4-cdf1-4296-ba90-53245c63393a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:40.459961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-666ec8c4-cdf1-4296-ba90-53245c63393a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:40.470058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-666ec8c4-cdf1-4296-ba90-53245c63393a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.471872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-666ec8c4-cdf1-4296-ba90-53245c63393a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.473714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-666ec8c4-cdf1-4296-ba90-53245c63393a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.474396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-666ec8c4-cdf1-4296-ba90-53245c63393a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.575850 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b6638004-2f49-44af-a2f3-4b5d4810c17d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:40.576610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b6638004-2f49-44af-a2f3-4b5d4810c17d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:40.586885 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6638004-2f49-44af-a2f3-4b5d4810c17d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.591679 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6638004-2f49-44af-a2f3-4b5d4810c17d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.592990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6638004-2f49-44af-a2f3-4b5d4810c17d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.593743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6638004-2f49-44af-a2f3-4b5d4810c17d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.784489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b6638004-2f49-44af-a2f3-4b5d4810c17d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:40.810265 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b6638004-2f49-44af-a2f3-4b5d4810c17d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1244 microversion: 2.1 time: 0.237529 Jul 14 11:07:40.828818 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 33/64] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:40 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1244 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:40.850558 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0531c76e-e747-45a5-b4f1-547d952179f4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:40.854031 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0531c76e-e747-45a5-b4f1-547d952179f4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:40.881522 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0531c76e-e747-45a5-b4f1-547d952179f4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.884272 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0531c76e-e747-45a5-b4f1-547d952179f4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.888289 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0531c76e-e747-45a5-b4f1-547d952179f4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.890691 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0531c76e-e747-45a5-b4f1-547d952179f4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.902915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-666ec8c4-cdf1-4296-ba90-53245c63393a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:40.952826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-666ec8c4-cdf1-4296-ba90-53245c63393a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1275 microversion: 2.1 time: 0.496083 Jul 14 11:07:40.959499 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 32/65] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:40 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1275 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:41.170798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0531c76e-e747-45a5-b4f1-547d952179f4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:41.187781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0531c76e-e747-45a5-b4f1-547d952179f4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1225 microversion: 2.1 time: 0.356399 Jul 14 11:07:41.195632 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 34/66] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:40 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1225 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:41.406285 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:41.410637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:41.462230 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:41.471437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:41.478802 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:41.507265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:41.729552 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:41.752322 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:41.757323 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:41.762097 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ea3fa061-7646-46cc-be5c-3fc998c44da1 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1285 microversion: 2.20 time: 0.361436 Jul 14 11:07:41.779428 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:41 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:41.840002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9bcb98d4-2f02-42ec-a98c-7a606ad5003d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:41.846600 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9bcb98d4-2f02-42ec-a98c-7a606ad5003d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:41.861480 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9bcb98d4-2f02-42ec-a98c-7a606ad5003d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:41.862469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9bcb98d4-2f02-42ec-a98c-7a606ad5003d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:41.864931 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9bcb98d4-2f02-42ec-a98c-7a606ad5003d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:41.865678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9bcb98d4-2f02-42ec-a98c-7a606ad5003d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:41.971932 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7bb616c7-f894-4bd2-9b80-c62f8ea5a59b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:41.972408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7bb616c7-f894-4bd2-9b80-c62f8ea5a59b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:41.988004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bb616c7-f894-4bd2-9b80-c62f8ea5a59b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:41.988468 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bb616c7-f894-4bd2-9b80-c62f8ea5a59b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:41.989258 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bb616c7-f894-4bd2-9b80-c62f8ea5a59b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:41.989434 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9bcb98d4-2f02-42ec-a98c-7a606ad5003d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:41.989704 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bb616c7-f894-4bd2-9b80-c62f8ea5a59b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:42.003036 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9bcb98d4-2f02-42ec-a98c-7a606ad5003d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1292 microversion: 2.1 time: 0.171591 Jul 14 11:07:42.004387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 35/68] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:41 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1292 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:42.223083 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-14a2161c-d329-4692-8041-5bb5c82dc2df tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:42.223810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-14a2161c-d329-4692-8041-5bb5c82dc2df tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:42.245740 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14a2161c-d329-4692-8041-5bb5c82dc2df tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:42.246461 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14a2161c-d329-4692-8041-5bb5c82dc2df tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:42.251127 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14a2161c-d329-4692-8041-5bb5c82dc2df tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:42.251951 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14a2161c-d329-4692-8041-5bb5c82dc2df tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:42.529161 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-14a2161c-d329-4692-8041-5bb5c82dc2df tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:42.572755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-14a2161c-d329-4692-8041-5bb5c82dc2df tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1281 microversion: 2.1 time: 0.352789 Jul 14 11:07:42.574179 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 36/69] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:42 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1281 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:07:42.593553 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7bb616c7-f894-4bd2-9b80-c62f8ea5a59b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:42.614221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7bb616c7-f894-4bd2-9b80-c62f8ea5a59b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1273 microversion: 2.1 time: 0.644447 Jul 14 11:07:42.615678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 34/70] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:41 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1273 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:42.781978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:42.782975 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:42.798734 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:42.799203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:42.805616 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:42.807041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:43.023108 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-06082a9e-e900-4861-9a31-3e4f21d6aca2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:43.023842 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-06082a9e-e900-4861-9a31-3e4f21d6aca2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:43.037051 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06082a9e-e900-4861-9a31-3e4f21d6aca2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:43.037865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06082a9e-e900-4861-9a31-3e4f21d6aca2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:43.039281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06082a9e-e900-4861-9a31-3e4f21d6aca2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:43.040498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06082a9e-e900-4861-9a31-3e4f21d6aca2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:43.667889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:43.686982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:43.693363 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:43.695888 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-97757f08-2f85-4ba5-a276-e4e7d757f398 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1277 microversion: 2.20 time: 0.918585 Jul 14 11:07:43.700446 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 37/71] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:42 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1277 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:43.709472 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88fb1b90-c184-418d-b86a-4d1f99b8df7f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:43.720335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88fb1b90-c184-418d-b86a-4d1f99b8df7f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:43.729463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-06082a9e-e900-4861-9a31-3e4f21d6aca2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:43.741094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88fb1b90-c184-418d-b86a-4d1f99b8df7f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:43.741821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88fb1b90-c184-418d-b86a-4d1f99b8df7f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:43.747841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88fb1b90-c184-418d-b86a-4d1f99b8df7f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:43.749036 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88fb1b90-c184-418d-b86a-4d1f99b8df7f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:43.792520 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-06082a9e-e900-4861-9a31-3e4f21d6aca2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1300 microversion: 2.1 time: 0.771318 Jul 14 11:07:43.803765 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 35/72] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:43 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1300 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:43.840457 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-11a953fe-fc21-481d-82b0-3ab6707ee433 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:43.847649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-11a953fe-fc21-481d-82b0-3ab6707ee433 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:43.885234 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11a953fe-fc21-481d-82b0-3ab6707ee433 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:43.899829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11a953fe-fc21-481d-82b0-3ab6707ee433 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:43.901089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11a953fe-fc21-481d-82b0-3ab6707ee433 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:43.901838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11a953fe-fc21-481d-82b0-3ab6707ee433 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:44.092297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88fb1b90-c184-418d-b86a-4d1f99b8df7f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:44.110870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88fb1b90-c184-418d-b86a-4d1f99b8df7f tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1279 microversion: 2.1 time: 0.408980 Jul 14 11:07:44.119460 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 38/73] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:43 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1279 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:44.387092 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-11a953fe-fc21-481d-82b0-3ab6707ee433 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:44.400320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-11a953fe-fc21-481d-82b0-3ab6707ee433 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1273 microversion: 2.1 time: 0.590477 Jul 14 11:07:44.401022 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 36/74] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:43 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1273 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:44.742842 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:44.744466 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:44.756420 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:44.757332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:44.764864 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:44.766234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:44.821202 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0bef64a0-7c7a-47a8-94f2-75b4e1bd6744 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:44.822615 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0bef64a0-7c7a-47a8-94f2-75b4e1bd6744 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:44.843809 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bef64a0-7c7a-47a8-94f2-75b4e1bd6744 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:44.845480 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bef64a0-7c7a-47a8-94f2-75b4e1bd6744 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:44.849915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bef64a0-7c7a-47a8-94f2-75b4e1bd6744 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:44.853453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bef64a0-7c7a-47a8-94f2-75b4e1bd6744 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:45.161262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:45.181371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:45.183117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:45.184347 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88e41530-9cc6-4bec-92aa-042af593e9a4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1351 microversion: 2.20 time: 0.455269 Jul 14 11:07:45.184925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 39/75] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:44 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1351 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:45.204460 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-00809617-c030-413d-8fbf-a510984535a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:45.205086 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-00809617-c030-413d-8fbf-a510984535a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:45.262824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00809617-c030-413d-8fbf-a510984535a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:45.272376 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00809617-c030-413d-8fbf-a510984535a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:45.281748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00809617-c030-413d-8fbf-a510984535a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:45.286867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00809617-c030-413d-8fbf-a510984535a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:45.567215 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0bef64a0-7c7a-47a8-94f2-75b4e1bd6744 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:45.590726 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0bef64a0-7c7a-47a8-94f2-75b4e1bd6744 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1298 microversion: 2.1 time: 0.777809 Jul 14 11:07:45.592833 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 37/76] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:44 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1298 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:45.608646 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ce6f9fad-a634-463b-9d4a-6cd0975d5d1a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:45.609551 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ce6f9fad-a634-463b-9d4a-6cd0975d5d1a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:45.618401 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:45.633012 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ce6f9fad-a634-463b-9d4a-6cd0975d5d1a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:45.634892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ce6f9fad-a634-463b-9d4a-6cd0975d5d1a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:45.639988 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ce6f9fad-a634-463b-9d4a-6cd0975d5d1a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:45.641138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ce6f9fad-a634-463b-9d4a-6cd0975d5d1a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:46.036680 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ce6f9fad-a634-463b-9d4a-6cd0975d5d1a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:46.050732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ce6f9fad-a634-463b-9d4a-6cd0975d5d1a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1273 microversion: 2.1 time: 0.456555 Jul 14 11:07:46.056239 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 38/77] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:45 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1273 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:46.207114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:46.208749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:46.221045 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:46.224106 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:46.226204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:46.230503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:46.421741 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:46.457509 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:46.463924 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:46.465433 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-16c9ce2b-6de8-4b0d-969d-e4e11781bf2e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1339 microversion: 2.20 time: 0.263515 Jul 14 11:07:46.475344 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 39/78] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:46 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:46.586893 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-00809617-c030-413d-8fbf-a510984535a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:46.603887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-00809617-c030-413d-8fbf-a510984535a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1279 microversion: 2.1 time: 1.414566 Jul 14 11:07:46.609968 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 40/79] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:45 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1279 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:46.619691 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4c8c32e5-700b-443e-9092-9ab546b805f2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:46.621528 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4c8c32e5-700b-443e-9092-9ab546b805f2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:46.652341 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4c8c32e5-700b-443e-9092-9ab546b805f2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:46.655323 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4c8c32e5-700b-443e-9092-9ab546b805f2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:46.658171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4c8c32e5-700b-443e-9092-9ab546b805f2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:46.661182 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4c8c32e5-700b-443e-9092-9ab546b805f2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:46.800717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4c8c32e5-700b-443e-9092-9ab546b805f2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:46.810519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4c8c32e5-700b-443e-9092-9ab546b805f2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1298 microversion: 2.1 time: 0.205836 Jul 14 11:07:46.827797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 40/80] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:46 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:47.075545 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9ecee822-8afa-4891-8135-3a6abd904865 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:47.076146 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9ecee822-8afa-4891-8135-3a6abd904865 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:47.098222 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ecee822-8afa-4891-8135-3a6abd904865 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:47.098932 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ecee822-8afa-4891-8135-3a6abd904865 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:47.099766 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ecee822-8afa-4891-8135-3a6abd904865 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:47.100363 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ecee822-8afa-4891-8135-3a6abd904865 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:47.391491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9ecee822-8afa-4891-8135-3a6abd904865 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:47.406742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9ecee822-8afa-4891-8135-3a6abd904865 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.335697 Jul 14 11:07:47.407409 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 41/81] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:47 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:47.490355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:47.491014 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:47.498005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:47.498806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:47.499637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:47.500239 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:47.595843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:47.621341 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:47.622991 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e25e12d3-8586-4b65-af83-ad806c3a2b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:47.623576 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:47.623778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e25e12d3-8586-4b65-af83-ad806c3a2b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:47.624816 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9b4052f6-29fd-4cf8-8f55-629e9b4d44aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1339 microversion: 2.20 time: 0.138464 Jul 14 11:07:47.625462 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 41/82] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:47 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1339 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:47.637708 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e25e12d3-8586-4b65-af83-ad806c3a2b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:47.638291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e25e12d3-8586-4b65-af83-ad806c3a2b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:47.639165 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e25e12d3-8586-4b65-af83-ad806c3a2b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:47.639703 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e25e12d3-8586-4b65-af83-ad806c3a2b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:47.827435 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bf28b404-90e7-4815-b162-72d0e1c8cab5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:47.828140 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bf28b404-90e7-4815-b162-72d0e1c8cab5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:47.831742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e25e12d3-8586-4b65-af83-ad806c3a2b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:47.839800 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf28b404-90e7-4815-b162-72d0e1c8cab5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:47.839940 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf28b404-90e7-4815-b162-72d0e1c8cab5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:47.840640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf28b404-90e7-4815-b162-72d0e1c8cab5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:47.841082 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf28b404-90e7-4815-b162-72d0e1c8cab5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:47.846748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e25e12d3-8586-4b65-af83-ad806c3a2b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.228414 Jul 14 11:07:47.848936 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 42/83] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:47 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:47.949166 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bf28b404-90e7-4815-b162-72d0e1c8cab5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:47.968207 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bf28b404-90e7-4815-b162-72d0e1c8cab5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1298 microversion: 2.1 time: 0.143142 Jul 14 11:07:47.970000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 42/84] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:47 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:48.426826 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b7cb42fb-185c-4730-830a-2d237f2493d1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:48.427860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b7cb42fb-185c-4730-830a-2d237f2493d1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:48.431218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:48.437982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7cb42fb-185c-4730-830a-2d237f2493d1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:48.438447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7cb42fb-185c-4730-830a-2d237f2493d1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:48.439263 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7cb42fb-185c-4730-830a-2d237f2493d1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:48.439869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7cb42fb-185c-4730-830a-2d237f2493d1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:48.594106 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b7cb42fb-185c-4730-830a-2d237f2493d1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:48.602321 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b7cb42fb-185c-4730-830a-2d237f2493d1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.181047 Jul 14 11:07:48.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 43/85] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:48 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:48.645168 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:48.645815 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:48.653944 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:48.654794 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:48.655760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:48.656436 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:48.729055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:48.738000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:48.740123 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:48.741565 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-404f914e-d9ae-4545-bab5-5b67b2026448 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1339 microversion: 2.20 time: 0.101063 Jul 14 11:07:48.742490 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 43/86] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:48 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:48.871180 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b1c277d4-4d24-4069-9f53-e3bfefdefd4e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:48.871994 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b1c277d4-4d24-4069-9f53-e3bfefdefd4e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:48.880052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1c277d4-4d24-4069-9f53-e3bfefdefd4e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:48.880722 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1c277d4-4d24-4069-9f53-e3bfefdefd4e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:48.881826 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1c277d4-4d24-4069-9f53-e3bfefdefd4e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:48.882375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1c277d4-4d24-4069-9f53-e3bfefdefd4e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:48.998679 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f4417eef-3e89-4e3b-b512-f451cacb9b08 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:48.999525 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f4417eef-3e89-4e3b-b512-f451cacb9b08 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:49.008716 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f4417eef-3e89-4e3b-b512-f451cacb9b08 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:49.009508 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f4417eef-3e89-4e3b-b512-f451cacb9b08 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:49.010534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f4417eef-3e89-4e3b-b512-f451cacb9b08 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:49.011221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f4417eef-3e89-4e3b-b512-f451cacb9b08 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:49.106125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b1c277d4-4d24-4069-9f53-e3bfefdefd4e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:49.106627 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f4417eef-3e89-4e3b-b512-f451cacb9b08 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:49.114562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f4417eef-3e89-4e3b-b512-f451cacb9b08 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1298 microversion: 2.1 time: 0.126844 Jul 14 11:07:49.119530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b1c277d4-4d24-4069-9f53-e3bfefdefd4e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.255905 Jul 14 11:07:49.121588 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 44/87] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:48 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:49.122438 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 44/88] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:48 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:49.620354 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1b567075-cc14-4594-8ec8-a22023b800e9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:49.621014 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1b567075-cc14-4594-8ec8-a22023b800e9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:49.628108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b567075-cc14-4594-8ec8-a22023b800e9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:49.629053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b567075-cc14-4594-8ec8-a22023b800e9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:49.629986 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b567075-cc14-4594-8ec8-a22023b800e9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:49.630422 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b567075-cc14-4594-8ec8-a22023b800e9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:49.765637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:49.767059 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:49.799917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:49.800755 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:49.801813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:49.802326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:49.938881 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1b567075-cc14-4594-8ec8-a22023b800e9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:49.952779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1b567075-cc14-4594-8ec8-a22023b800e9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.335434 Jul 14 11:07:49.952779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 45/89] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:49 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:50.014102 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:50.025368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:50.033545 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:50.037922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-99d07cbc-bfc2-4953-865a-f4ea65df6a2b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1339 microversion: 2.20 time: 0.279508 Jul 14 11:07:50.039015 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 45/90] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:49 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1339 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:07:50.146860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-164e898c-50d6-47c6-8e5e-89b04c3b8c89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:50.148464 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c93fc970-2485-4c63-9462-4bfe7f24cfd8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:50.149101 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c93fc970-2485-4c63-9462-4bfe7f24cfd8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:50.150268 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-164e898c-50d6-47c6-8e5e-89b04c3b8c89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:50.160902 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=8 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:50.164910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=32 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:50.172691 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-164e898c-50d6-47c6-8e5e-89b04c3b8c89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:50.173214 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-164e898c-50d6-47c6-8e5e-89b04c3b8c89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:50.179365 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-164e898c-50d6-47c6-8e5e-89b04c3b8c89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:50.180083 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-164e898c-50d6-47c6-8e5e-89b04c3b8c89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:50.180491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c93fc970-2485-4c63-9462-4bfe7f24cfd8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:50.183512 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c93fc970-2485-4c63-9462-4bfe7f24cfd8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:50.191490 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c93fc970-2485-4c63-9462-4bfe7f24cfd8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:50.196548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c93fc970-2485-4c63-9462-4bfe7f24cfd8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:50.375968 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=18 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:50.956876 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c93fc970-2485-4c63-9462-4bfe7f24cfd8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:50.968971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-164e898c-50d6-47c6-8e5e-89b04c3b8c89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:50.974647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c93fc970-2485-4c63-9462-4bfe7f24cfd8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1298 microversion: 2.1 time: 0.834407 Jul 14 11:07:50.978749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 46/91] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:50 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1298 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:51.009412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e527074e-abbe-4a56-abc8-9209e391c3c1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:51.011851 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-164e898c-50d6-47c6-8e5e-89b04c3b8c89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.872449 Jul 14 11:07:51.014204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e527074e-abbe-4a56-abc8-9209e391c3c1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:51.021727 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 46/92] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:50 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:51.036863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e527074e-abbe-4a56-abc8-9209e391c3c1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:51.053377 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e527074e-abbe-4a56-abc8-9209e391c3c1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:51.055194 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e527074e-abbe-4a56-abc8-9209e391c3c1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:51.077587 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:51.080445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:51.088252 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e527074e-abbe-4a56-abc8-9209e391c3c1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:51.100869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:51.145472 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:51.171814 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:51.180353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:51.213351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:51.214821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:51.234208 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:51.602360 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:51.621136 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:51.627562 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:51.629438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d879245-dfbd-447f-b79b-29d76f42fc4c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1339 microversion: 2.20 time: 0.569953 Jul 14 11:07:51.648039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 47/93] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:51 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1339 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:51.995646 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62892cb8-82a7-4d5f-a038-dfcc877c9ea2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:52.001120 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62892cb8-82a7-4d5f-a038-dfcc877c9ea2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:52.017078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62892cb8-82a7-4d5f-a038-dfcc877c9ea2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:52.022681 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62892cb8-82a7-4d5f-a038-dfcc877c9ea2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:52.032336 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62892cb8-82a7-4d5f-a038-dfcc877c9ea2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:52.036405 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62892cb8-82a7-4d5f-a038-dfcc877c9ea2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:53.022732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62892cb8-82a7-4d5f-a038-dfcc877c9ea2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:53.066675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62892cb8-82a7-4d5f-a038-dfcc877c9ea2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1298 microversion: 2.1 time: 1.075600 Jul 14 11:07:53.076921 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 48/94] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:51 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1298 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:53.106872 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eb457e0d-9ed3-4315-b599-e14d59070c54 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:53.109737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eb457e0d-9ed3-4315-b599-e14d59070c54 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:53.141716 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb457e0d-9ed3-4315-b599-e14d59070c54 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:53.143063 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb457e0d-9ed3-4315-b599-e14d59070c54 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:53.148774 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb457e0d-9ed3-4315-b599-e14d59070c54 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:53.150384 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb457e0d-9ed3-4315-b599-e14d59070c54 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:54.061643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e527074e-abbe-4a56-abc8-9209e391c3c1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:54.070484 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e527074e-abbe-4a56-abc8-9209e391c3c1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 3.085922 Jul 14 11:07:54.073677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 47/95] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:50 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 3094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:54.086145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:54.087001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:54.107237 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:54.115540 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:54.116834 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:54.117429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:54.390814 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eb457e0d-9ed3-4315-b599-e14d59070c54 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:54.418868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eb457e0d-9ed3-4315-b599-e14d59070c54 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 1.337452 Jul 14 11:07:54.420799 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 49/96] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:53 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:54.437677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-21c427d5-e8ee-4a6f-961a-150aa8c2f3a5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:54.446808 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-21c427d5-e8ee-4a6f-961a-150aa8c2f3a5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:54.471971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21c427d5-e8ee-4a6f-961a-150aa8c2f3a5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:54.477017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21c427d5-e8ee-4a6f-961a-150aa8c2f3a5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:54.478773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21c427d5-e8ee-4a6f-961a-150aa8c2f3a5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:54.483507 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21c427d5-e8ee-4a6f-961a-150aa8c2f3a5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:55.596852 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-21c427d5-e8ee-4a6f-961a-150aa8c2f3a5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:55.612177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-21c427d5-e8ee-4a6f-961a-150aa8c2f3a5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 1.189386 Jul 14 11:07:55.612775 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 50/97] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:54 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:55.623154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-01fd1a9c-6873-48f8-8254-0938b42dd92b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:55.630965 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-01fd1a9c-6873-48f8-8254-0938b42dd92b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:55.653338 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01fd1a9c-6873-48f8-8254-0938b42dd92b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:55.659457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01fd1a9c-6873-48f8-8254-0938b42dd92b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:55.661425 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01fd1a9c-6873-48f8-8254-0938b42dd92b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:55.666046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01fd1a9c-6873-48f8-8254-0938b42dd92b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:56.428834 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-01fd1a9c-6873-48f8-8254-0938b42dd92b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:56.472474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-01fd1a9c-6873-48f8-8254-0938b42dd92b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.844529 Jul 14 11:07:56.473647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 51/98] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:55 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:56.490729 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ae65d351-3f64-411d-85b6-a92ef8f35237 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:56.491948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ae65d351-3f64-411d-85b6-a92ef8f35237 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:56.502485 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae65d351-3f64-411d-85b6-a92ef8f35237 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:56.503860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae65d351-3f64-411d-85b6-a92ef8f35237 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:56.505854 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae65d351-3f64-411d-85b6-a92ef8f35237 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:56.507375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae65d351-3f64-411d-85b6-a92ef8f35237 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:56.673814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:56.710400 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:56.715243 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:56.720531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-68fc41cb-36c9-4d15-aaad-d8872380fde4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 2.637990 Jul 14 11:07:56.722723 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 48/99] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:54 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 2641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:56.728087 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6bb1ea08-812d-45ab-b19d-4bd4bf671a79 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:56.728760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6bb1ea08-812d-45ab-b19d-4bd4bf671a79 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:56.740466 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6bb1ea08-812d-45ab-b19d-4bd4bf671a79 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:56.741055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6bb1ea08-812d-45ab-b19d-4bd4bf671a79 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:56.742837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6bb1ea08-812d-45ab-b19d-4bd4bf671a79 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:56.743951 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6bb1ea08-812d-45ab-b19d-4bd4bf671a79 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:57.254446 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ae65d351-3f64-411d-85b6-a92ef8f35237 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:57.266388 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ae65d351-3f64-411d-85b6-a92ef8f35237 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.791083 Jul 14 11:07:57.270700 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 52/100] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:56 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:57.492675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-286458ea-e007-49d7-ad11-9543dd85e095 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:57.493489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-286458ea-e007-49d7-ad11-9543dd85e095 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:57.509993 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-286458ea-e007-49d7-ad11-9543dd85e095 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:57.511601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-286458ea-e007-49d7-ad11-9543dd85e095 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:57.512674 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-286458ea-e007-49d7-ad11-9543dd85e095 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:57.514616 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-286458ea-e007-49d7-ad11-9543dd85e095 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:57.655371 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6bb1ea08-812d-45ab-b19d-4bd4bf671a79 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:57.736375 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6bb1ea08-812d-45ab-b19d-4bd4bf671a79 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 1.006869 Jul 14 11:07:57.783775 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 49/101] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:56 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:57.803606 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:57.806504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:57.831513 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:57.833048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:57.835147 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:57.837569 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:58.600433 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-286458ea-e007-49d7-ad11-9543dd85e095 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:58.613681 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-286458ea-e007-49d7-ad11-9543dd85e095 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 1.126037 Jul 14 11:07:58.614276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 53/102] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:57 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:58.942947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-f13eba2e-b029-4367-bbe3-8125cfb756c9 req-4b5b903c-89d9-4ecb-a414-78bd3a30b63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15adbd9-9e3f-4368-8dc4-45ecc5436d5d", "tag": "24f57bda-0f9e-4061-8641-12b57f112b43"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:58.968631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f13eba2e-b029-4367-bbe3-8125cfb756c9 req-4b5b903c-89d9-4ecb-a414-78bd3a30b63f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:58.969521 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f13eba2e-b029-4367-bbe3-8125cfb756c9 req-4b5b903c-89d9-4ecb-a414-78bd3a30b63f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:59.012762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-f13eba2e-b029-4367-bbe3-8125cfb756c9 req-4b5b903c-89d9-4ecb-a414-78bd3a30b63f service nova] Creating event network-changed:24f57bda-0f9e-4061-8641-12b57f112b43 for instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d on hv-cinder-84893 Jul 14 11:07:59.013460 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f13eba2e-b029-4367-bbe3-8125cfb756c9 req-4b5b903c-89d9-4ecb-a414-78bd3a30b63f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 11:07:59.015486 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ef88d84-8923-4598-b6d2-1ae952c669e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:59.015865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ef88d84-8923-4598-b6d2-1ae952c669e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:59.016684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ef88d84-8923-4598-b6d2-1ae952c669e6 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:59.017112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ef88d84-8923-4598-b6d2-1ae952c669e6 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:59.047247 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.compute.rpcapi [None req-5ef88d84-8923-4598-b6d2-1ae952c669e6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 11:07:59.049335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ef88d84-8923-4598-b6d2-1ae952c669e6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 11:07:59.118655 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5ef88d84-8923-4598-b6d2-1ae952c669e6 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491628 Jul 14 11:07:59.120315 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 54/103] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:59.158504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ea191dfb-574c-43a0-8322-e5394c326138 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:59.158504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ea191dfb-574c-43a0-8322-e5394c326138 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:59.178042 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea191dfb-574c-43a0-8322-e5394c326138 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:59.180261 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea191dfb-574c-43a0-8322-e5394c326138 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:59.181255 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea191dfb-574c-43a0-8322-e5394c326138 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:59.181791 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea191dfb-574c-43a0-8322-e5394c326138 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:59.790454 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:59.799322 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:59.806897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:59.820866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-08fd7bd4-3a98-404b-9183-1813540cb7de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 2.033902 Jul 14 11:07:59.822391 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 50/104] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:07:57 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:07:59.828855 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f7cb035f-74e7-472d-a04a-46b98cc2b91e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:59.829976 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f7cb035f-74e7-472d-a04a-46b98cc2b91e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:59.845847 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ea191dfb-574c-43a0-8322-e5394c326138 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:59.857513 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ea191dfb-574c-43a0-8322-e5394c326138 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.735166 Jul 14 11:07:59.864294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f7cb035f-74e7-472d-a04a-46b98cc2b91e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:59.864911 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 55/105] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:59 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:59.870405 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a6bf2068-b3d8-490f-9503-1d48cc807856 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:59.871328 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f7cb035f-74e7-472d-a04a-46b98cc2b91e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:59.872391 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f7cb035f-74e7-472d-a04a-46b98cc2b91e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:59.873036 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f7cb035f-74e7-472d-a04a-46b98cc2b91e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:59.877370 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a6bf2068-b3d8-490f-9503-1d48cc807856 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:59.898851 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a6bf2068-b3d8-490f-9503-1d48cc807856 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:59.899588 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a6bf2068-b3d8-490f-9503-1d48cc807856 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:59.901685 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a6bf2068-b3d8-490f-9503-1d48cc807856 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:59.902294 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a6bf2068-b3d8-490f-9503-1d48cc807856 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:00.345746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a6bf2068-b3d8-490f-9503-1d48cc807856 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:00.355911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f7cb035f-74e7-472d-a04a-46b98cc2b91e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:00.357747 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a6bf2068-b3d8-490f-9503-1d48cc807856 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.491250 Jul 14 11:08:00.358567 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 56/106] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:59 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:00.372114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f7cb035f-74e7-472d-a04a-46b98cc2b91e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.547878 Jul 14 11:08:00.372689 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 51/107] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:59 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:00.530678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-66422a2f-7aee-4131-b8d6-21bbd310a3f1 req-1d312d9f-9d8b-4033-838b-a3f83b0b93ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd47a70-769e-4bfc-8954-376cd1d1dd8f", "tag": "f17cb494-ce01-4f03-b511-25356a886eab"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:00.543036 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-66422a2f-7aee-4131-b8d6-21bbd310a3f1 req-1d312d9f-9d8b-4033-838b-a3f83b0b93ab service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:00.543521 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-66422a2f-7aee-4131-b8d6-21bbd310a3f1 req-1d312d9f-9d8b-4033-838b-a3f83b0b93ab service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:00.556507 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-66422a2f-7aee-4131-b8d6-21bbd310a3f1 req-1d312d9f-9d8b-4033-838b-a3f83b0b93ab service nova] Creating event network-changed:f17cb494-ce01-4f03-b511-25356a886eab for instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f on hv-cinder-84893 Jul 14 11:08:00.562201 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-66422a2f-7aee-4131-b8d6-21bbd310a3f1 req-1d312d9f-9d8b-4033-838b-a3f83b0b93ab service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202076 Jul 14 11:08:00.563181 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 57/108] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:08:00.841221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:00.842361 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:00.853024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:00.853490 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:00.854308 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:00.854746 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:00.881790 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fdb82149-9b26-4967-aa85-5d52ec9b6b20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:00.884009 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fdb82149-9b26-4967-aa85-5d52ec9b6b20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:00.893088 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdb82149-9b26-4967-aa85-5d52ec9b6b20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:00.893742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdb82149-9b26-4967-aa85-5d52ec9b6b20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:00.895281 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdb82149-9b26-4967-aa85-5d52ec9b6b20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:00.895935 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdb82149-9b26-4967-aa85-5d52ec9b6b20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:01.072505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:01.084069 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:01.086307 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:01.088293 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b33fc7ae-1caf-464b-ad69-dffa8a978f15 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.251694 Jul 14 11:08:01.090701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 52/109] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:00 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:01.149580 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fdb82149-9b26-4967-aa85-5d52ec9b6b20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:01.159953 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fdb82149-9b26-4967-aa85-5d52ec9b6b20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.283617 Jul 14 11:08:01.168522 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 58/110] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:00 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:01.246680 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-a0bbc9f5-45de-42ed-afe6-2b995fcb02c5 req-a2a60fef-ef86-4e4f-8f24-268abfa998ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d03bde1-0583-4099-8098-0077a2fc1084", "tag": "81b715b1-2ff3-4295-9104-d4e547039e70"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:01.259248 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a0bbc9f5-45de-42ed-afe6-2b995fcb02c5 req-a2a60fef-ef86-4e4f-8f24-268abfa998ca service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:01.259655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a0bbc9f5-45de-42ed-afe6-2b995fcb02c5 req-a2a60fef-ef86-4e4f-8f24-268abfa998ca service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:01.284415 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-a0bbc9f5-45de-42ed-afe6-2b995fcb02c5 req-a2a60fef-ef86-4e4f-8f24-268abfa998ca service nova] Creating event network-changed:81b715b1-2ff3-4295-9104-d4e547039e70 for instance 4d03bde1-0583-4099-8098-0077a2fc1084 on hv-cinder-84893 Jul 14 11:08:01.285315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a0bbc9f5-45de-42ed-afe6-2b995fcb02c5 req-a2a60fef-ef86-4e4f-8f24-268abfa998ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=117888) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 11:08:01.286930 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d56da81-949a-48dd-9454-ea6aa8383db0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:01.287512 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d56da81-949a-48dd-9454-ea6aa8383db0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:01.288396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d56da81-949a-48dd-9454-ea6aa8383db0 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:01.288804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d56da81-949a-48dd-9454-ea6aa8383db0 None None] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:01.299762 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.compute.rpcapi [None req-4d56da81-949a-48dd-9454-ea6aa8383db0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 11:08:01.300967 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d56da81-949a-48dd-9454-ea6aa8383db0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117888) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 11:08:01.332970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4d56da81-949a-48dd-9454-ea6aa8383db0 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090806 Jul 14 11:08:01.334136 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 53/111] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:08:01.377480 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0d3075db-e0cc-4f7b-8370-af0ab122faf8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:01.378704 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0d3075db-e0cc-4f7b-8370-af0ab122faf8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:01.388387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d3075db-e0cc-4f7b-8370-af0ab122faf8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:01.389104 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d3075db-e0cc-4f7b-8370-af0ab122faf8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:01.390080 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d3075db-e0cc-4f7b-8370-af0ab122faf8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:01.390697 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d3075db-e0cc-4f7b-8370-af0ab122faf8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:01.396713 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b8d6e52f-37db-4e49-8da3-a4cea6fa6b37 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:01.397622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b8d6e52f-37db-4e49-8da3-a4cea6fa6b37 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:01.406904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8d6e52f-37db-4e49-8da3-a4cea6fa6b37 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:01.407592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8d6e52f-37db-4e49-8da3-a4cea6fa6b37 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:01.408538 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8d6e52f-37db-4e49-8da3-a4cea6fa6b37 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:01.409200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8d6e52f-37db-4e49-8da3-a4cea6fa6b37 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:01.580130 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0d3075db-e0cc-4f7b-8370-af0ab122faf8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:01.597801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0d3075db-e0cc-4f7b-8370-af0ab122faf8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.225743 Jul 14 11:08:01.601769 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 59/112] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:01 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:01.626374 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b8d6e52f-37db-4e49-8da3-a4cea6fa6b37 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:01.635004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b8d6e52f-37db-4e49-8da3-a4cea6fa6b37 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.243376 Jul 14 11:08:01.635964 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 54/113] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:01 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:02.109523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:02.110272 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:02.123746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.123746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.124534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.125008 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.181638 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-815d8e22-a84e-4753-ba94-478847c2a194 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:02.182553 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-815d8e22-a84e-4753-ba94-478847c2a194 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:02.188766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-815d8e22-a84e-4753-ba94-478847c2a194 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.189207 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-815d8e22-a84e-4753-ba94-478847c2a194 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.189988 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-815d8e22-a84e-4753-ba94-478847c2a194 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.190423 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-815d8e22-a84e-4753-ba94-478847c2a194 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.596594 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-815d8e22-a84e-4753-ba94-478847c2a194 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:02.605995 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-815d8e22-a84e-4753-ba94-478847c2a194 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.428806 Jul 14 11:08:02.608057 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:02.608845 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 55/114] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:02 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:02.629641 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:02.632375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:02.635010 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-db14e3bf-1204-4d80-af5c-f56aa67c8026 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.530399 Jul 14 11:08:02.636712 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 60/115] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:02 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:02.642245 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4b3dd4e4-3388-4147-98ec-006688020594 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:02.643208 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4b3dd4e4-3388-4147-98ec-006688020594 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:02.646754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-4ec9788b-918b-45db-b15f-44b6ef5534a5 req-ab3bedec-7d5a-437f-9274-2603a7f2657f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb87b2e-2f5d-429a-95a9-1af62edd1e2b", "tag": "13944c62-ebab-45c6-93d8-38bb5fd3a687"}, {"name": "network-changed", "server_uuid": "9966b0a3-56f9-486d-99ba-0e616d15167a", "tag": "60ab608d-54a2-43be-9f6e-4c5078b5c6b4"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:02.656248 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b3dd4e4-3388-4147-98ec-006688020594 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.657946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b3dd4e4-3388-4147-98ec-006688020594 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.659533 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b3dd4e4-3388-4147-98ec-006688020594 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.660524 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b3dd4e4-3388-4147-98ec-006688020594 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.673988 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-4ec9788b-918b-45db-b15f-44b6ef5534a5 req-ab3bedec-7d5a-437f-9274-2603a7f2657f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.674841 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-4ec9788b-918b-45db-b15f-44b6ef5534a5 req-ab3bedec-7d5a-437f-9274-2603a7f2657f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.700278 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-4ec9788b-918b-45db-b15f-44b6ef5534a5 req-ab3bedec-7d5a-437f-9274-2603a7f2657f service nova] Creating event network-changed:13944c62-ebab-45c6-93d8-38bb5fd3a687 for instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b on hv-cinder-84893 Jul 14 11:08:02.701157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-4ec9788b-918b-45db-b15f-44b6ef5534a5 req-ab3bedec-7d5a-437f-9274-2603a7f2657f service nova] Creating event network-changed:60ab608d-54a2-43be-9f6e-4c5078b5c6b4 for instance 9966b0a3-56f9-486d-99ba-0e616d15167a on hv-cinder-84893 Jul 14 11:08:02.718064 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-4ec9788b-918b-45db-b15f-44b6ef5534a5 req-ab3bedec-7d5a-437f-9274-2603a7f2657f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.107792 Jul 14 11:08:02.722395 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 56/116] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:08:02.737170 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9c6df485-4424-48e8-af68-fb0d450374d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:02.738322 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9c6df485-4424-48e8-af68-fb0d450374d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:02.749768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c6df485-4424-48e8-af68-fb0d450374d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.750231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c6df485-4424-48e8-af68-fb0d450374d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.751040 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c6df485-4424-48e8-af68-fb0d450374d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:02.751528 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c6df485-4424-48e8-af68-fb0d450374d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:02.926300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4b3dd4e4-3388-4147-98ec-006688020594 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:02.935325 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4b3dd4e4-3388-4147-98ec-006688020594 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.297235 Jul 14 11:08:02.945612 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 61/117] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:02 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:03.060394 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9c6df485-4424-48e8-af68-fb0d450374d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:03.069443 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9c6df485-4424-48e8-af68-fb0d450374d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.345376 Jul 14 11:08:03.081188 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 57/118] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:02 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:03.628077 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-873b5130-49c9-49f8-90e9-977a8641eff8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:03.628678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-873b5130-49c9-49f8-90e9-977a8641eff8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:03.637198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-873b5130-49c9-49f8-90e9-977a8641eff8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:03.637515 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-873b5130-49c9-49f8-90e9-977a8641eff8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:03.638524 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-873b5130-49c9-49f8-90e9-977a8641eff8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:03.639473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-873b5130-49c9-49f8-90e9-977a8641eff8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:03.659661 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:03.660271 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:03.670286 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:03.670749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:03.672422 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:03.673012 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:03.796923 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-873b5130-49c9-49f8-90e9-977a8641eff8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:03.806297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-873b5130-49c9-49f8-90e9-977a8641eff8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.183997 Jul 14 11:08:03.806890 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 62/119] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:03 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:03.854917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:03.863811 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:03.865462 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:03.866674 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ba59c08a-74de-4e9e-8551-5f27bfc46e90 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.212462 Jul 14 11:08:03.867373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 58/120] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:03 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:03.955096 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3835ec6a-4c9b-4c49-8511-10e6732115c4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:03.956219 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3835ec6a-4c9b-4c49-8511-10e6732115c4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:03.968009 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3835ec6a-4c9b-4c49-8511-10e6732115c4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:03.968947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3835ec6a-4c9b-4c49-8511-10e6732115c4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:03.969640 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3835ec6a-4c9b-4c49-8511-10e6732115c4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:03.970082 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3835ec6a-4c9b-4c49-8511-10e6732115c4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:04.088280 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-987dc1ec-ca71-4d25-914b-7795e34c09ed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:04.089296 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-987dc1ec-ca71-4d25-914b-7795e34c09ed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:04.097438 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-987dc1ec-ca71-4d25-914b-7795e34c09ed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:04.098036 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-987dc1ec-ca71-4d25-914b-7795e34c09ed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:04.098935 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-987dc1ec-ca71-4d25-914b-7795e34c09ed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:04.099476 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-987dc1ec-ca71-4d25-914b-7795e34c09ed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:04.186534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3835ec6a-4c9b-4c49-8511-10e6732115c4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:04.201962 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3835ec6a-4c9b-4c49-8511-10e6732115c4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.250363 Jul 14 11:08:04.203258 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 63/121] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:03 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:04.324145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-987dc1ec-ca71-4d25-914b-7795e34c09ed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:04.331839 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-987dc1ec-ca71-4d25-914b-7795e34c09ed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.248255 Jul 14 11:08:04.332748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 59/122] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:04 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:04.824233 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bbb54dbe-b712-46ea-9dad-e09979d7789e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:04.825748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bbb54dbe-b712-46ea-9dad-e09979d7789e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:04.832559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bbb54dbe-b712-46ea-9dad-e09979d7789e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:04.833017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bbb54dbe-b712-46ea-9dad-e09979d7789e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:04.834023 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bbb54dbe-b712-46ea-9dad-e09979d7789e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:04.834474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bbb54dbe-b712-46ea-9dad-e09979d7789e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:04.886876 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:04.887808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:04.894714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:04.895304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:04.896232 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:04.896959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:05.029943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bbb54dbe-b712-46ea-9dad-e09979d7789e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:05.033543 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:05.039316 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bbb54dbe-b712-46ea-9dad-e09979d7789e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.219454 Jul 14 11:08:05.040101 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 64/123] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:04 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:05.070272 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:05.078824 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:05.080371 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:05.081459 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a637d3c9-6567-4aec-ae26-e4e63f4fcc1e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.199764 Jul 14 11:08:05.082005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 60/124] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:04 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:08:05.223482 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a152d02-d3c5-428a-a9ae-486c8a82a230 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:05.224158 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a152d02-d3c5-428a-a9ae-486c8a82a230 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:05.231979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a152d02-d3c5-428a-a9ae-486c8a82a230 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:05.232606 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a152d02-d3c5-428a-a9ae-486c8a82a230 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:05.233454 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a152d02-d3c5-428a-a9ae-486c8a82a230 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:05.233977 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a152d02-d3c5-428a-a9ae-486c8a82a230 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:05.349754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2ee0da4e-c2e2-4eaf-839a-29e8b2741441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:05.350402 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2ee0da4e-c2e2-4eaf-839a-29e8b2741441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:05.357340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee0da4e-c2e2-4eaf-839a-29e8b2741441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:05.357843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee0da4e-c2e2-4eaf-839a-29e8b2741441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:05.358621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee0da4e-c2e2-4eaf-839a-29e8b2741441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:05.359050 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee0da4e-c2e2-4eaf-839a-29e8b2741441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:05.386311 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a152d02-d3c5-428a-a9ae-486c8a82a230 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:05.394329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a152d02-d3c5-428a-a9ae-486c8a82a230 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.175523 Jul 14 11:08:05.395252 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 65/125] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:05 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:05.498654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2ee0da4e-c2e2-4eaf-839a-29e8b2741441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:05.506815 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2ee0da4e-c2e2-4eaf-839a-29e8b2741441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.160957 Jul 14 11:08:05.507422 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 61/126] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:05 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:06.059645 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d799e9f-0769-4d4d-bf10-d7c8971d8a2d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:06.061424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d799e9f-0769-4d4d-bf10-d7c8971d8a2d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:06.069961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d799e9f-0769-4d4d-bf10-d7c8971d8a2d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:06.070726 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d799e9f-0769-4d4d-bf10-d7c8971d8a2d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:06.072076 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d799e9f-0769-4d4d-bf10-d7c8971d8a2d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:06.073503 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d799e9f-0769-4d4d-bf10-d7c8971d8a2d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:06.105428 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:06.106280 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:06.113788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:06.114340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:06.115329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:06.115888 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:06.269827 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d799e9f-0769-4d4d-bf10-d7c8971d8a2d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:06.281495 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d799e9f-0769-4d4d-bf10-d7c8971d8a2d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.229398 Jul 14 11:08:06.282093 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 66/127] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:06 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:06.327658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:06.336966 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:06.338472 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:06.339866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0a23a1d8-8b93-449f-a7af-2b90e39016f0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.238336 Jul 14 11:08:06.340445 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 62/128] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:06 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:08:06.413403 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f0f3824-648e-4e41-80ad-0acb147ff7cc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:06.414031 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f0f3824-648e-4e41-80ad-0acb147ff7cc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:06.421128 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f0f3824-648e-4e41-80ad-0acb147ff7cc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:06.421635 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f0f3824-648e-4e41-80ad-0acb147ff7cc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:06.422426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f0f3824-648e-4e41-80ad-0acb147ff7cc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:06.422999 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f0f3824-648e-4e41-80ad-0acb147ff7cc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:06.524887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-632017b6-4a8f-493a-854f-0055f862bf2e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:06.526262 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-632017b6-4a8f-493a-854f-0055f862bf2e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:06.533174 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-632017b6-4a8f-493a-854f-0055f862bf2e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:06.533629 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-632017b6-4a8f-493a-854f-0055f862bf2e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:06.534412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-632017b6-4a8f-493a-854f-0055f862bf2e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:06.534849 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-632017b6-4a8f-493a-854f-0055f862bf2e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:06.597859 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0f0f3824-648e-4e41-80ad-0acb147ff7cc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:06.616482 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f0f3824-648e-4e41-80ad-0acb147ff7cc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.206956 Jul 14 11:08:06.617147 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 67/129] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:06 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:06.703414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-632017b6-4a8f-493a-854f-0055f862bf2e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:06.714607 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-632017b6-4a8f-493a-854f-0055f862bf2e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.193537 Jul 14 11:08:06.715515 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 63/130] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:06 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:07.299062 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a4ff3d8-b8fd-483d-99ba-91f0244e9b8a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:07.299728 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a4ff3d8-b8fd-483d-99ba-91f0244e9b8a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:07.306247 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a4ff3d8-b8fd-483d-99ba-91f0244e9b8a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:07.307509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a4ff3d8-b8fd-483d-99ba-91f0244e9b8a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:07.308866 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a4ff3d8-b8fd-483d-99ba-91f0244e9b8a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:07.309765 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a4ff3d8-b8fd-483d-99ba-91f0244e9b8a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:07.357852 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:07.358680 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:07.372114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:07.372934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:07.373973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:07.374637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:07.522434 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a4ff3d8-b8fd-483d-99ba-91f0244e9b8a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:07.537935 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a4ff3d8-b8fd-483d-99ba-91f0244e9b8a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.242849 Jul 14 11:08:07.538677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 68/131] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:07 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:07.586088 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:07.590934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:07.597968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:07.600397 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:07.601909 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3c2a3dbf-2f1f-4d99-a66d-db9f187ee1e5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.248048 Jul 14 11:08:07.603055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 64/132] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:07 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:07.639422 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-30b46ed8-ca54-4491-b3a1-90c515bf1ff8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:07.640102 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-30b46ed8-ca54-4491-b3a1-90c515bf1ff8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:07.646489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30b46ed8-ca54-4491-b3a1-90c515bf1ff8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:07.647196 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30b46ed8-ca54-4491-b3a1-90c515bf1ff8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:07.648197 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30b46ed8-ca54-4491-b3a1-90c515bf1ff8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:07.648766 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30b46ed8-ca54-4491-b3a1-90c515bf1ff8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:07.733850 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cf3cc0d3-87f6-460b-b281-884ec77d3687 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:07.734754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cf3cc0d3-87f6-460b-b281-884ec77d3687 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:07.741086 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf3cc0d3-87f6-460b-b281-884ec77d3687 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:07.741542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf3cc0d3-87f6-460b-b281-884ec77d3687 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:07.742353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf3cc0d3-87f6-460b-b281-884ec77d3687 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:07.742796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf3cc0d3-87f6-460b-b281-884ec77d3687 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:07.803562 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-30b46ed8-ca54-4491-b3a1-90c515bf1ff8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:07.812314 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-30b46ed8-ca54-4491-b3a1-90c515bf1ff8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.177437 Jul 14 11:08:07.812905 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 69/133] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:07 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:07.894329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cf3cc0d3-87f6-460b-b281-884ec77d3687 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:07.903179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cf3cc0d3-87f6-460b-b281-884ec77d3687 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.174864 Jul 14 11:08:07.904667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 65/134] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:07 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:08.561426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a222b274-ae56-4801-bb82-41ea887a17f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:08.565524 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a222b274-ae56-4801-bb82-41ea887a17f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:08.575678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a222b274-ae56-4801-bb82-41ea887a17f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:08.576304 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a222b274-ae56-4801-bb82-41ea887a17f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:08.577348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a222b274-ae56-4801-bb82-41ea887a17f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:08.578780 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a222b274-ae56-4801-bb82-41ea887a17f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:08.629068 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:08.631798 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:08.647231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:08.650566 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:08.652525 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:08.653320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:08.901296 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:08.921492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a222b274-ae56-4801-bb82-41ea887a17f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:08.924872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:08.928854 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:08.932835 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-76de9db0-8d43-4301-956e-80722af0a1ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.313475 Jul 14 11:08:08.934046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 66/135] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:08 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:08.937218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a222b274-ae56-4801-bb82-41ea887a17f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.384881 Jul 14 11:08:08.939464 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 70/136] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:08 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:08.960608 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c3e08219-515c-4d84-b00f-6429d7f24d91 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:08.961224 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c3e08219-515c-4d84-b00f-6429d7f24d91 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:08.966670 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9f6f8336-1aeb-4219-a266-2c081d52a809 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:08.968395 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9f6f8336-1aeb-4219-a266-2c081d52a809 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:08.978903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9f6f8336-1aeb-4219-a266-2c081d52a809 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:08.979738 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9f6f8336-1aeb-4219-a266-2c081d52a809 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:08.980030 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3e08219-515c-4d84-b00f-6429d7f24d91 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:08.981016 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3e08219-515c-4d84-b00f-6429d7f24d91 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:08.981159 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9f6f8336-1aeb-4219-a266-2c081d52a809 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:08.981801 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9f6f8336-1aeb-4219-a266-2c081d52a809 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:08.982211 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3e08219-515c-4d84-b00f-6429d7f24d91 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:08.982727 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3e08219-515c-4d84-b00f-6429d7f24d91 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:09.039804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:09.235314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9f6f8336-1aeb-4219-a266-2c081d52a809 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:09.257991 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c3e08219-515c-4d84-b00f-6429d7f24d91 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:09.264834 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9f6f8336-1aeb-4219-a266-2c081d52a809 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.329171 Jul 14 11:08:09.269777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 67/137] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:08 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:09.273341 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c3e08219-515c-4d84-b00f-6429d7f24d91 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.332651 Jul 14 11:08:09.274429 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 71/138] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:08 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:09.605697 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-a3093a3c-83e1-45a0-9680-ee69ad5fa5c8 req-932c506d-e4b0-4bc9-8296-e05f9c339c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15adbd9-9e3f-4368-8dc4-45ecc5436d5d", "name": "network-vif-plugged", "status": "completed", "tag": "24f57bda-0f9e-4061-8641-12b57f112b43"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:09.620375 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a3093a3c-83e1-45a0-9680-ee69ad5fa5c8 req-932c506d-e4b0-4bc9-8296-e05f9c339c21 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:09.621522 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a3093a3c-83e1-45a0-9680-ee69ad5fa5c8 req-932c506d-e4b0-4bc9-8296-e05f9c339c21 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:09.635651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-a3093a3c-83e1-45a0-9680-ee69ad5fa5c8 req-932c506d-e4b0-4bc9-8296-e05f9c339c21 service nova] Creating event network-vif-plugged:24f57bda-0f9e-4061-8641-12b57f112b43 for instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d on hv-cinder-84893 Jul 14 11:08:09.644822 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-a3093a3c-83e1-45a0-9680-ee69ad5fa5c8 req-932c506d-e4b0-4bc9-8296-e05f9c339c21 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370804 Jul 14 11:08:09.649193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 68/139] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:08:09.956184 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-637c379f-f11d-4b15-9466-1c6e9bfbe7c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:09.957802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-637c379f-f11d-4b15-9466-1c6e9bfbe7c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:09.963809 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:09.964544 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:09.970599 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-637c379f-f11d-4b15-9466-1c6e9bfbe7c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:09.971075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-637c379f-f11d-4b15-9466-1c6e9bfbe7c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:09.971919 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-637c379f-f11d-4b15-9466-1c6e9bfbe7c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:09.972358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-637c379f-f11d-4b15-9466-1c6e9bfbe7c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:09.972562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:09.972984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:09.973752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:09.974406 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:10.243273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:10.260145 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-637c379f-f11d-4b15-9466-1c6e9bfbe7c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:10.261495 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:10.267079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:10.267079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-080c8380-ebd7-4bbd-8c21-46358ae01d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.307297 Jul 14 11:08:10.269401 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 69/140] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:09 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:08:10.274390 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-637c379f-f11d-4b15-9466-1c6e9bfbe7c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.323355 Jul 14 11:08:10.275089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 72/141] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:09 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:10.290976 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9f2c27df-1798-4d53-8b8a-12b8e4473620 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:10.293777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9f2c27df-1798-4d53-8b8a-12b8e4473620 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:10.297731 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fbad89b6-235e-41fa-8d9e-bdccce07d628 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:10.298467 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fbad89b6-235e-41fa-8d9e-bdccce07d628 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:10.307934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f2c27df-1798-4d53-8b8a-12b8e4473620 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:10.310814 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f2c27df-1798-4d53-8b8a-12b8e4473620 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:10.313989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f2c27df-1798-4d53-8b8a-12b8e4473620 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:10.314706 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f2c27df-1798-4d53-8b8a-12b8e4473620 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:10.315312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fbad89b6-235e-41fa-8d9e-bdccce07d628 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:10.316030 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fbad89b6-235e-41fa-8d9e-bdccce07d628 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:10.317190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fbad89b6-235e-41fa-8d9e-bdccce07d628 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:10.318048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fbad89b6-235e-41fa-8d9e-bdccce07d628 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:10.516356 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fbad89b6-235e-41fa-8d9e-bdccce07d628 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:10.526648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fbad89b6-235e-41fa-8d9e-bdccce07d628 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.239832 Jul 14 11:08:10.529536 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 70/142] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:10 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:10.543733 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9f2c27df-1798-4d53-8b8a-12b8e4473620 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:10.551801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9f2c27df-1798-4d53-8b8a-12b8e4473620 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.265264 Jul 14 11:08:10.552758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 73/143] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:10 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:11.297532 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:11.298020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:11.300444 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:11.304248 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-563ac895-e5ff-4b7e-9c65-b8f5a0d7fc09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:11.306063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:11.306511 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:11.306865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-563ac895-e5ff-4b7e-9c65-b8f5a0d7fc09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:11.307424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:11.307856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:11.317442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-563ac895-e5ff-4b7e-9c65-b8f5a0d7fc09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:11.317961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-563ac895-e5ff-4b7e-9c65-b8f5a0d7fc09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:11.318849 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-563ac895-e5ff-4b7e-9c65-b8f5a0d7fc09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:11.319534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-563ac895-e5ff-4b7e-9c65-b8f5a0d7fc09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:11.502993 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:11.513179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:11.516560 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:11.518756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d0162b23-0b1b-45f0-8b9d-37aaf4ea871a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.226772 Jul 14 11:08:11.521809 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-563ac895-e5ff-4b7e-9c65-b8f5a0d7fc09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:11.530587 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-563ac895-e5ff-4b7e-9c65-b8f5a0d7fc09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.233067 Jul 14 11:08:11.531624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 74/144] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:11 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:11.532790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 71/145] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:11 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:11.548105 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5c76f6a6-7fa5-46be-9835-c1287ff2b06b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:11.548492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5c76f6a6-7fa5-46be-9835-c1287ff2b06b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:11.556735 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c76f6a6-7fa5-46be-9835-c1287ff2b06b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:11.556735 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c76f6a6-7fa5-46be-9835-c1287ff2b06b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:11.557890 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c76f6a6-7fa5-46be-9835-c1287ff2b06b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:11.558420 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c76f6a6-7fa5-46be-9835-c1287ff2b06b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:11.568774 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cef6db03-47f1-4b88-b907-069d6eca79bd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:11.569373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cef6db03-47f1-4b88-b907-069d6eca79bd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:11.576151 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cef6db03-47f1-4b88-b907-069d6eca79bd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:11.576887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cef6db03-47f1-4b88-b907-069d6eca79bd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:11.578159 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cef6db03-47f1-4b88-b907-069d6eca79bd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:11.579003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cef6db03-47f1-4b88-b907-069d6eca79bd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:11.710348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5c76f6a6-7fa5-46be-9835-c1287ff2b06b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:11.721188 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5c76f6a6-7fa5-46be-9835-c1287ff2b06b tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.177540 Jul 14 11:08:11.721600 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 75/146] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:11 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:11.804217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cef6db03-47f1-4b88-b907-069d6eca79bd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:11.813751 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cef6db03-47f1-4b88-b907-069d6eca79bd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.248746 Jul 14 11:08:11.814953 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 72/147] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:11 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:12.542997 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:12.545514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:12.551742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:12.552357 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:12.555217 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:12.558052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:12.558282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a884ce34-dcdf-41e6-908f-42395f0f6b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:12.560496 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a884ce34-dcdf-41e6-908f-42395f0f6b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:12.570107 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a884ce34-dcdf-41e6-908f-42395f0f6b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:12.571104 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a884ce34-dcdf-41e6-908f-42395f0f6b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:12.573162 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a884ce34-dcdf-41e6-908f-42395f0f6b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:12.573777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a884ce34-dcdf-41e6-908f-42395f0f6b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:12.742075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:12.754046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:12.758912 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:12.761263 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-597d72b0-751f-4b13-a491-c37316044bde tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.226415 Jul 14 11:08:12.762274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 76/148] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:12 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:12.777262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-848cc359-e42e-440b-ba47-8b8c57cb52a9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:12.778783 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-848cc359-e42e-440b-ba47-8b8c57cb52a9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:12.794791 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-848cc359-e42e-440b-ba47-8b8c57cb52a9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:12.796593 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-848cc359-e42e-440b-ba47-8b8c57cb52a9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:12.798278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-848cc359-e42e-440b-ba47-8b8c57cb52a9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:12.798873 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-848cc359-e42e-440b-ba47-8b8c57cb52a9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:12.811191 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a884ce34-dcdf-41e6-908f-42395f0f6b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:12.820807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a884ce34-dcdf-41e6-908f-42395f0f6b01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.272976 Jul 14 11:08:12.822016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 73/149] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:12 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:12.836282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c21a08d5-f802-4f3b-85cd-2c09cd79f1a2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:12.837866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c21a08d5-f802-4f3b-85cd-2c09cd79f1a2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:12.851974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c21a08d5-f802-4f3b-85cd-2c09cd79f1a2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:12.852710 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c21a08d5-f802-4f3b-85cd-2c09cd79f1a2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:12.854490 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c21a08d5-f802-4f3b-85cd-2c09cd79f1a2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:12.855195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c21a08d5-f802-4f3b-85cd-2c09cd79f1a2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:13.013172 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-848cc359-e42e-440b-ba47-8b8c57cb52a9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:13.023649 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-848cc359-e42e-440b-ba47-8b8c57cb52a9 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.258732 Jul 14 11:08:13.025077 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 77/150] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:12 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:13.048133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c21a08d5-f802-4f3b-85cd-2c09cd79f1a2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:13.058656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c21a08d5-f802-4f3b-85cd-2c09cd79f1a2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.227182 Jul 14 11:08:13.066700 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 74/151] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:12 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:13.782521 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:13.784023 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:13.799874 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:13.800326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:13.801725 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:13.802425 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:13.837208 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ebba4fb8-96ed-4e7f-bfb7-f111d4c9e8d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:13.838986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ebba4fb8-96ed-4e7f-bfb7-f111d4c9e8d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:13.850876 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebba4fb8-96ed-4e7f-bfb7-f111d4c9e8d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:13.851646 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebba4fb8-96ed-4e7f-bfb7-f111d4c9e8d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:13.852577 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebba4fb8-96ed-4e7f-bfb7-f111d4c9e8d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:13.853187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebba4fb8-96ed-4e7f-bfb7-f111d4c9e8d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:14.073877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:14.090936 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:14.092848 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:14.094043 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c09c4f18-dcc9-40d9-a8c6-09be481adb4f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.316978 Jul 14 11:08:14.105006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 78/152] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:13 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:14.115339 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0aca5a7d-5310-4f99-9b92-b7185cc748b8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:14.115339 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0aca5a7d-5310-4f99-9b92-b7185cc748b8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:14.122778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0aca5a7d-5310-4f99-9b92-b7185cc748b8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:14.123322 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ebba4fb8-96ed-4e7f-bfb7-f111d4c9e8d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:14.123615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0aca5a7d-5310-4f99-9b92-b7185cc748b8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:14.125327 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0aca5a7d-5310-4f99-9b92-b7185cc748b8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:14.125969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0aca5a7d-5310-4f99-9b92-b7185cc748b8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:14.132289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ebba4fb8-96ed-4e7f-bfb7-f111d4c9e8d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.298359 Jul 14 11:08:14.133429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 75/153] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:13 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:14.139452 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7f39f9df-2b5a-4877-bc78-ef5204e8fa10 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:14.140342 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7f39f9df-2b5a-4877-bc78-ef5204e8fa10 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:14.153391 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f39f9df-2b5a-4877-bc78-ef5204e8fa10 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:14.153917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f39f9df-2b5a-4877-bc78-ef5204e8fa10 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:14.154829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f39f9df-2b5a-4877-bc78-ef5204e8fa10 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:14.155294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f39f9df-2b5a-4877-bc78-ef5204e8fa10 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:14.311889 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7f39f9df-2b5a-4877-bc78-ef5204e8fa10 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:14.312503 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0aca5a7d-5310-4f99-9b92-b7185cc748b8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:14.320833 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7f39f9df-2b5a-4877-bc78-ef5204e8fa10 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.186311 Jul 14 11:08:14.321324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0aca5a7d-5310-4f99-9b92-b7185cc748b8 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.215038 Jul 14 11:08:14.322198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 76/154] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:14 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:14.322499 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 79/155] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:14 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:15.112444 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:15.113080 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:15.119704 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:15.120600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:15.121557 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:15.122150 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:15.148881 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-459f9f34-3b12-4423-8565-d40c386af866 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:15.149674 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-459f9f34-3b12-4423-8565-d40c386af866 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:15.156990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-459f9f34-3b12-4423-8565-d40c386af866 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:15.157541 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-459f9f34-3b12-4423-8565-d40c386af866 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:15.158412 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-459f9f34-3b12-4423-8565-d40c386af866 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:15.159069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-459f9f34-3b12-4423-8565-d40c386af866 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:15.303048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:15.314009 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:15.315559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:15.316706 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d5307da8-133c-45bf-8f81-85b97307d5dd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.208459 Jul 14 11:08:15.317276 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 77/156] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:15 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:08:15.338832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9acf9a15-3852-4120-9a42-264730593476 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:15.339564 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9acf9a15-3852-4120-9a42-264730593476 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:15.346546 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9acf9a15-3852-4120-9a42-264730593476 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:15.347038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9acf9a15-3852-4120-9a42-264730593476 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:15.347875 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9acf9a15-3852-4120-9a42-264730593476 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:15.348311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9acf9a15-3852-4120-9a42-264730593476 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:15.378790 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-459f9f34-3b12-4423-8565-d40c386af866 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:15.387463 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-459f9f34-3b12-4423-8565-d40c386af866 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.242799 Jul 14 11:08:15.388123 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 80/157] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:15 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:15.392750 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cf390257-f384-46a1-bbe1-4ee641d8d352 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:15.393532 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cf390257-f384-46a1-bbe1-4ee641d8d352 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:15.399978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf390257-f384-46a1-bbe1-4ee641d8d352 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:15.400402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf390257-f384-46a1-bbe1-4ee641d8d352 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:15.401443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf390257-f384-46a1-bbe1-4ee641d8d352 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:15.402035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf390257-f384-46a1-bbe1-4ee641d8d352 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:15.441714 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:15.557910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9acf9a15-3852-4120-9a42-264730593476 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:15.569384 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9acf9a15-3852-4120-9a42-264730593476 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.234976 Jul 14 11:08:15.580559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 78/158] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:15 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:15.628197 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cf390257-f384-46a1-bbe1-4ee641d8d352 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:15.660994 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cf390257-f384-46a1-bbe1-4ee641d8d352 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.271559 Jul 14 11:08:15.662001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 81/159] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:15 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:16.335628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:16.336395 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:16.339019 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=81 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:16.344495 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:16.345043 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:16.345909 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:16.346411 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:16.404658 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-77d07047-2b1a-4756-a165-1a23353df788 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:16.405355 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-77d07047-2b1a-4756-a165-1a23353df788 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:16.411637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-77d07047-2b1a-4756-a165-1a23353df788 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:16.412085 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-77d07047-2b1a-4756-a165-1a23353df788 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:16.412857 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-77d07047-2b1a-4756-a165-1a23353df788 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:16.413283 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-77d07047-2b1a-4756-a165-1a23353df788 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:16.504688 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:16.513945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:16.515800 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:16.517143 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9d809c07-1537-4de3-bfd9-8b7c27d166fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.185629 Jul 14 11:08:16.518040 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 79/160] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:16 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:16.564187 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-77d07047-2b1a-4756-a165-1a23353df788 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:16.572822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-77d07047-2b1a-4756-a165-1a23353df788 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.172383 Jul 14 11:08:16.573399 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 82/161] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:16 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:16.593441 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2df7d8b0-9237-436a-9c3b-d6a1b5fcb056 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:16.594129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2df7d8b0-9237-436a-9c3b-d6a1b5fcb056 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:16.600533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2df7d8b0-9237-436a-9c3b-d6a1b5fcb056 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:16.600985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2df7d8b0-9237-436a-9c3b-d6a1b5fcb056 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:16.601730 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2df7d8b0-9237-436a-9c3b-d6a1b5fcb056 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:16.602154 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2df7d8b0-9237-436a-9c3b-d6a1b5fcb056 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:16.680398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2d5ce9c5-d94a-4a20-a069-ffe2db3dffd6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:16.681654 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2d5ce9c5-d94a-4a20-a069-ffe2db3dffd6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:16.688141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d5ce9c5-d94a-4a20-a069-ffe2db3dffd6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:16.688731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d5ce9c5-d94a-4a20-a069-ffe2db3dffd6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:16.689672 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d5ce9c5-d94a-4a20-a069-ffe2db3dffd6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:16.690246 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d5ce9c5-d94a-4a20-a069-ffe2db3dffd6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:16.759158 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2df7d8b0-9237-436a-9c3b-d6a1b5fcb056 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:16.768659 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2df7d8b0-9237-436a-9c3b-d6a1b5fcb056 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.185240 Jul 14 11:08:16.770264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 80/162] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:16 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:16.848455 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2d5ce9c5-d94a-4a20-a069-ffe2db3dffd6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:16.856442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2d5ce9c5-d94a-4a20-a069-ffe2db3dffd6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.179937 Jul 14 11:08:16.857250 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 83/163] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:16 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:17.538000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:17.540896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:17.548505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:17.549031 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:17.549874 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:17.550366 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:17.590122 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-08b25c85-d83d-402d-8ba7-4c9ef2b65b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:17.590854 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-08b25c85-d83d-402d-8ba7-4c9ef2b65b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:17.597703 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08b25c85-d83d-402d-8ba7-4c9ef2b65b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:17.598154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08b25c85-d83d-402d-8ba7-4c9ef2b65b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:17.598925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08b25c85-d83d-402d-8ba7-4c9ef2b65b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:17.599652 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08b25c85-d83d-402d-8ba7-4c9ef2b65b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:17.733884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-08b25c85-d83d-402d-8ba7-4c9ef2b65b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:17.741989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-08b25c85-d83d-402d-8ba7-4c9ef2b65b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.155729 Jul 14 11:08:17.742730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 84/164] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:17 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:17.786357 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-80f3d558-679f-42fb-b0e5-f6a02b976257 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:17.787122 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-80f3d558-679f-42fb-b0e5-f6a02b976257 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:17.794110 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80f3d558-679f-42fb-b0e5-f6a02b976257 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:17.794678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80f3d558-679f-42fb-b0e5-f6a02b976257 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:17.795564 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80f3d558-679f-42fb-b0e5-f6a02b976257 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:17.796071 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80f3d558-679f-42fb-b0e5-f6a02b976257 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:17.917874 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:17.930006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:17.931702 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:17.932989 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c5bfe70c-4770-47a9-a1a8-f218e4670397 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.398933 Jul 14 11:08:17.933708 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 81/165] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:17 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:17.939284 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80f3d558-679f-42fb-b0e5-f6a02b976257 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:17.950725 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6b52ce30-4c50-455f-aba2-a475881742e2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:17.951317 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6b52ce30-4c50-455f-aba2-a475881742e2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:17.960048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-80f3d558-679f-42fb-b0e5-f6a02b976257 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.177297 Jul 14 11:08:17.960759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b52ce30-4c50-455f-aba2-a475881742e2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:17.961205 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 85/166] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:17 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:17.961633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b52ce30-4c50-455f-aba2-a475881742e2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:17.962648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b52ce30-4c50-455f-aba2-a475881742e2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:17.963788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b52ce30-4c50-455f-aba2-a475881742e2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:17.968217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:18.107687 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6b52ce30-4c50-455f-aba2-a475881742e2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:18.115345 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6b52ce30-4c50-455f-aba2-a475881742e2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.180381 Jul 14 11:08:18.115956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 82/167] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:17 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:18.758453 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8ad98ac0-9357-49a1-a144-f79e6ce07685 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:18.758996 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8ad98ac0-9357-49a1-a144-f79e6ce07685 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:18.765571 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ad98ac0-9357-49a1-a144-f79e6ce07685 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:18.766022 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ad98ac0-9357-49a1-a144-f79e6ce07685 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:18.766784 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ad98ac0-9357-49a1-a144-f79e6ce07685 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:18.767218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ad98ac0-9357-49a1-a144-f79e6ce07685 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:18.908930 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ad98ac0-9357-49a1-a144-f79e6ce07685 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:18.917249 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8ad98ac0-9357-49a1-a144-f79e6ce07685 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.162628 Jul 14 11:08:18.918051 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 86/168] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:18 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:18.953424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:18.954051 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:18.960202 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:18.960650 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:18.961416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:18.961848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:18.990835 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-708a4dad-c781-450e-bb19-37407282bad4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:18.997438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-708a4dad-c781-450e-bb19-37407282bad4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:19.006737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-708a4dad-c781-450e-bb19-37407282bad4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:19.007278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-708a4dad-c781-450e-bb19-37407282bad4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:19.008301 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-708a4dad-c781-450e-bb19-37407282bad4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:19.008872 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-708a4dad-c781-450e-bb19-37407282bad4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:19.115236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:19.124027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:19.125548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:19.126779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9fcd4400-04e0-4455-918a-3cad94cdee34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.177171 Jul 14 11:08:19.127510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 83/169] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:18 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:19.131858 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-78283c47-cf19-4473-8287-02869c01336c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:19.132470 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-78283c47-cf19-4473-8287-02869c01336c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:19.138801 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-78283c47-cf19-4473-8287-02869c01336c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:19.139251 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-78283c47-cf19-4473-8287-02869c01336c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:19.140060 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-78283c47-cf19-4473-8287-02869c01336c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:19.140495 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-78283c47-cf19-4473-8287-02869c01336c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:19.154224 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-708a4dad-c781-450e-bb19-37407282bad4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:19.161842 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-708a4dad-c781-450e-bb19-37407282bad4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.187658 Jul 14 11:08:19.163434 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 87/170] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:18 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:19.275233 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-78283c47-cf19-4473-8287-02869c01336c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:19.282879 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-78283c47-cf19-4473-8287-02869c01336c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.154396 Jul 14 11:08:19.283550 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 84/171] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:19 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:19.936000 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-65bbddc5-7bb6-4864-bb6e-7c7c92011c84 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:19.936605 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-65bbddc5-7bb6-4864-bb6e-7c7c92011c84 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:19.942749 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65bbddc5-7bb6-4864-bb6e-7c7c92011c84 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:19.943203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65bbddc5-7bb6-4864-bb6e-7c7c92011c84 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:19.944062 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65bbddc5-7bb6-4864-bb6e-7c7c92011c84 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:19.944506 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65bbddc5-7bb6-4864-bb6e-7c7c92011c84 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:20.079035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-65bbddc5-7bb6-4864-bb6e-7c7c92011c84 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:20.086938 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-65bbddc5-7bb6-4864-bb6e-7c7c92011c84 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.154734 Jul 14 11:08:20.087547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 88/172] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:19 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:20.148317 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:20.148920 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:20.155617 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:20.156068 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:20.156831 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:20.157265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:20.177900 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4c47b483-eb4d-4316-af42-8ecce124d08c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:20.178502 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4c47b483-eb4d-4316-af42-8ecce124d08c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:20.184900 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c47b483-eb4d-4316-af42-8ecce124d08c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:20.185356 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c47b483-eb4d-4316-af42-8ecce124d08c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:20.186401 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c47b483-eb4d-4316-af42-8ecce124d08c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:20.187205 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c47b483-eb4d-4316-af42-8ecce124d08c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:20.300254 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:20.309758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:20.311240 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:20.312371 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-00f6e0af-1296-4efc-837e-c58ccd9b7701 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.169080 Jul 14 11:08:20.312931 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 85/173] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:20 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:20.317432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2d0c6207-6cff-421d-a47b-93e5a2632f3d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:20.318026 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2d0c6207-6cff-421d-a47b-93e5a2632f3d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:20.325462 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d0c6207-6cff-421d-a47b-93e5a2632f3d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:20.325974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d0c6207-6cff-421d-a47b-93e5a2632f3d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:20.326763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d0c6207-6cff-421d-a47b-93e5a2632f3d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:20.327310 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d0c6207-6cff-421d-a47b-93e5a2632f3d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:20.337288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4c47b483-eb4d-4316-af42-8ecce124d08c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:20.345067 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4c47b483-eb4d-4316-af42-8ecce124d08c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.170876 Jul 14 11:08:20.345777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 89/174] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:20 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:20.465699 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2d0c6207-6cff-421d-a47b-93e5a2632f3d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:20.473469 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2d0c6207-6cff-421d-a47b-93e5a2632f3d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.159577 Jul 14 11:08:20.474047 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 86/175] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:20 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:21.104383 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cf732575-dc2f-4efd-ada2-5f9966edde67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:21.104996 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cf732575-dc2f-4efd-ada2-5f9966edde67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:21.110948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf732575-dc2f-4efd-ada2-5f9966edde67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:21.111432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf732575-dc2f-4efd-ada2-5f9966edde67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:21.112207 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf732575-dc2f-4efd-ada2-5f9966edde67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:21.112647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf732575-dc2f-4efd-ada2-5f9966edde67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:21.246772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cf732575-dc2f-4efd-ada2-5f9966edde67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:21.254728 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cf732575-dc2f-4efd-ada2-5f9966edde67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.154669 Jul 14 11:08:21.255362 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 90/176] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:21 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:21.330138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:21.337946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:21.345450 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:21.345892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:21.346733 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:21.347099 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:21.363980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7ca6a6fd-897b-4095-88f5-9628d51a402a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:21.364586 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7ca6a6fd-897b-4095-88f5-9628d51a402a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:21.367677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=88 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:21.374016 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ca6a6fd-897b-4095-88f5-9628d51a402a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:21.374466 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ca6a6fd-897b-4095-88f5-9628d51a402a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:21.375269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ca6a6fd-897b-4095-88f5-9628d51a402a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:21.375727 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ca6a6fd-897b-4095-88f5-9628d51a402a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:21.484666 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:21.493142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:21.495357 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:21.496583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3f1a9bb6-90df-46cf-abf4-ae58a188e7c0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.170680 Jul 14 11:08:21.497156 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 87/177] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:21 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:08:21.501673 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3f26e63f-12a6-4edc-aeb1-2e805f97dc1f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:21.502286 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3f26e63f-12a6-4edc-aeb1-2e805f97dc1f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:21.509135 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f26e63f-12a6-4edc-aeb1-2e805f97dc1f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:21.509832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f26e63f-12a6-4edc-aeb1-2e805f97dc1f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:21.511329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f26e63f-12a6-4edc-aeb1-2e805f97dc1f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:21.511992 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f26e63f-12a6-4edc-aeb1-2e805f97dc1f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:21.529549 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7ca6a6fd-897b-4095-88f5-9628d51a402a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:21.538405 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7ca6a6fd-897b-4095-88f5-9628d51a402a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.178949 Jul 14 11:08:21.538988 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 91/178] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:21 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:21.651199 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f26e63f-12a6-4edc-aeb1-2e805f97dc1f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:21.658732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3f26e63f-12a6-4edc-aeb1-2e805f97dc1f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.160580 Jul 14 11:08:21.659297 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 88/179] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:21 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:22.271725 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-ecc3173c-f9a2-4a27-ac26-e399f27c2805 req-ba253e7c-6b45-40a7-9c94-639ec5357174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d03bde1-0583-4099-8098-0077a2fc1084", "name": "network-vif-plugged", "status": "completed", "tag": "81b715b1-2ff3-4295-9104-d4e547039e70"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:22.272645 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d35e844e-660f-44aa-b8c7-6496e0f0ac58 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:22.273341 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d35e844e-660f-44aa-b8c7-6496e0f0ac58 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:22.280576 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d35e844e-660f-44aa-b8c7-6496e0f0ac58 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.281007 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d35e844e-660f-44aa-b8c7-6496e0f0ac58 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.281712 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ecc3173c-f9a2-4a27-ac26-e399f27c2805 req-ba253e7c-6b45-40a7-9c94-639ec5357174 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.281950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d35e844e-660f-44aa-b8c7-6496e0f0ac58 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.282204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d35e844e-660f-44aa-b8c7-6496e0f0ac58 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.282407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ecc3173c-f9a2-4a27-ac26-e399f27c2805 req-ba253e7c-6b45-40a7-9c94-639ec5357174 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.296513 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-ecc3173c-f9a2-4a27-ac26-e399f27c2805 req-ba253e7c-6b45-40a7-9c94-639ec5357174 service nova] Creating event network-vif-plugged:81b715b1-2ff3-4295-9104-d4e547039e70 for instance 4d03bde1-0583-4099-8098-0077a2fc1084 on hv-cinder-84893 Jul 14 11:08:22.302314 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-ecc3173c-f9a2-4a27-ac26-e399f27c2805 req-ba253e7c-6b45-40a7-9c94-639ec5357174 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035413 Jul 14 11:08:22.302973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 92/180] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:08:22.426292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d35e844e-660f-44aa-b8c7-6496e0f0ac58 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:22.434005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d35e844e-660f-44aa-b8c7-6496e0f0ac58 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.165485 Jul 14 11:08:22.434520 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 89/181] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:22 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:22.515128 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:22.515834 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:22.522094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.522535 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.524013 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.524465 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.556396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ff2410cd-3fe3-489b-9204-b489daa0bbe1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:22.557165 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ff2410cd-3fe3-489b-9204-b489daa0bbe1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:22.563405 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff2410cd-3fe3-489b-9204-b489daa0bbe1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.563954 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff2410cd-3fe3-489b-9204-b489daa0bbe1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.564825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff2410cd-3fe3-489b-9204-b489daa0bbe1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.565269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff2410cd-3fe3-489b-9204-b489daa0bbe1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.667359 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:22.676243 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:22.677934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:22.679058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0ab339fa-bbb4-4eaf-b6e8-8500c2496f6b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.168184 Jul 14 11:08:22.679932 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 93/182] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:22 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:22.686368 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5127d61f-dc85-4071-b321-3901a6cd70e5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:22.687606 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5127d61f-dc85-4071-b321-3901a6cd70e5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:22.695207 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5127d61f-dc85-4071-b321-3901a6cd70e5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.695760 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5127d61f-dc85-4071-b321-3901a6cd70e5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.696575 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5127d61f-dc85-4071-b321-3901a6cd70e5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:22.697013 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5127d61f-dc85-4071-b321-3901a6cd70e5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:22.707936 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ff2410cd-3fe3-489b-9204-b489daa0bbe1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:22.719505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ff2410cd-3fe3-489b-9204-b489daa0bbe1 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.166877 Jul 14 11:08:22.720624 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 90/183] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:22 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:22.835270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5127d61f-dc85-4071-b321-3901a6cd70e5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:22.846504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5127d61f-dc85-4071-b321-3901a6cd70e5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.165230 Jul 14 11:08:22.847460 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 94/184] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:22 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:23.451224 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f04af03f-ec6c-4352-9afc-a47fe23533d1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:23.451864 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f04af03f-ec6c-4352-9afc-a47fe23533d1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:23.458141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f04af03f-ec6c-4352-9afc-a47fe23533d1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:23.458659 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f04af03f-ec6c-4352-9afc-a47fe23533d1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:23.459564 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f04af03f-ec6c-4352-9afc-a47fe23533d1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:23.460130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f04af03f-ec6c-4352-9afc-a47fe23533d1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:23.598619 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f04af03f-ec6c-4352-9afc-a47fe23533d1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:23.606782 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f04af03f-ec6c-4352-9afc-a47fe23533d1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.160148 Jul 14 11:08:23.607357 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 91/185] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:23 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:23.697677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:23.698291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:23.704413 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:23.704861 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:23.705632 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:23.706066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:23.736693 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2d6c3a12-1949-4a66-8070-a4b278393186 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:23.737442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2d6c3a12-1949-4a66-8070-a4b278393186 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:23.743943 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a12-1949-4a66-8070-a4b278393186 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:23.744556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a12-1949-4a66-8070-a4b278393186 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:23.745183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a12-1949-4a66-8070-a4b278393186 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:23.745703 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a12-1949-4a66-8070-a4b278393186 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:23.850644 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:23.859596 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:23.861349 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:23.862775 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d6d71b8c-af70-438c-b8ee-b66354899867 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.168792 Jul 14 11:08:23.863329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 95/186] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:23 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:23.868353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2aff56e7-0f7f-4cf8-95cd-f10f65b57fc9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:23.868948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2aff56e7-0f7f-4cf8-95cd-f10f65b57fc9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:23.876123 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2aff56e7-0f7f-4cf8-95cd-f10f65b57fc9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:23.876575 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2aff56e7-0f7f-4cf8-95cd-f10f65b57fc9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:23.877359 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2aff56e7-0f7f-4cf8-95cd-f10f65b57fc9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:23.877966 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2aff56e7-0f7f-4cf8-95cd-f10f65b57fc9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:23.897267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2d6c3a12-1949-4a66-8070-a4b278393186 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:23.905129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2d6c3a12-1949-4a66-8070-a4b278393186 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.172210 Jul 14 11:08:23.906065 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 92/187] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:23 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:24.031828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2aff56e7-0f7f-4cf8-95cd-f10f65b57fc9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:24.039881 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2aff56e7-0f7f-4cf8-95cd-f10f65b57fc9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.174804 Jul 14 11:08:24.040467 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 96/188] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:23 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:24.623877 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-24769268-1337-4ec4-af57-bc0039e15c23 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:24.624481 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-24769268-1337-4ec4-af57-bc0039e15c23 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:24.630363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-24769268-1337-4ec4-af57-bc0039e15c23 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:24.630808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-24769268-1337-4ec4-af57-bc0039e15c23 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:24.631592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-24769268-1337-4ec4-af57-bc0039e15c23 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:24.632024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-24769268-1337-4ec4-af57-bc0039e15c23 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:24.767411 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-24769268-1337-4ec4-af57-bc0039e15c23 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:24.776012 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-24769268-1337-4ec4-af57-bc0039e15c23 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.156470 Jul 14 11:08:24.776587 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 93/189] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:24 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:24.881451 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:24.882358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:24.888587 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:24.889288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:24.889896 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:24.890332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:24.923417 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-97806fa1-acae-4180-81e4-59ffe3b9db93 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:24.924212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-97806fa1-acae-4180-81e4-59ffe3b9db93 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:24.931087 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-97806fa1-acae-4180-81e4-59ffe3b9db93 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:24.931548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-97806fa1-acae-4180-81e4-59ffe3b9db93 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:24.933048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-97806fa1-acae-4180-81e4-59ffe3b9db93 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:24.933720 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-97806fa1-acae-4180-81e4-59ffe3b9db93 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:25.024346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:25.033483 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:25.034985 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:25.036121 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6dce5eb7-eb96-4e74-812b-493a96ffc5b3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.158567 Jul 14 11:08:25.036694 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 97/190] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:24 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:25.058186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4799b14c-a5a0-4dc5-a63f-53631d4295cb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:25.059045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4799b14c-a5a0-4dc5-a63f-53631d4295cb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:25.066338 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4799b14c-a5a0-4dc5-a63f-53631d4295cb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:25.066783 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4799b14c-a5a0-4dc5-a63f-53631d4295cb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:25.067603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4799b14c-a5a0-4dc5-a63f-53631d4295cb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:25.068028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4799b14c-a5a0-4dc5-a63f-53631d4295cb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:25.115484 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-97806fa1-acae-4180-81e4-59ffe3b9db93 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:25.126972 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-97806fa1-acae-4180-81e4-59ffe3b9db93 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.207828 Jul 14 11:08:25.128902 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 94/191] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:24 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:25.268939 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4799b14c-a5a0-4dc5-a63f-53631d4295cb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:25.272502 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:25.278511 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4799b14c-a5a0-4dc5-a63f-53631d4295cb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.224647 Jul 14 11:08:25.295632 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 98/192] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:25 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:25.793319 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3e4ccd76-bd85-4631-be21-b702962afc74 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:25.794172 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3e4ccd76-bd85-4631-be21-b702962afc74 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:25.800865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3e4ccd76-bd85-4631-be21-b702962afc74 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:25.801323 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3e4ccd76-bd85-4631-be21-b702962afc74 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:25.802102 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3e4ccd76-bd85-4631-be21-b702962afc74 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:25.802544 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3e4ccd76-bd85-4631-be21-b702962afc74 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:25.969758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3e4ccd76-bd85-4631-be21-b702962afc74 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:25.977441 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3e4ccd76-bd85-4631-be21-b702962afc74 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.188919 Jul 14 11:08:25.978008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 95/193] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:25 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:26.055809 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:26.056581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:26.063943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:26.064389 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:26.065213 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:26.065645 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:26.148134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-acb38071-1959-47ba-9412-d668f793038a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:26.149325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-acb38071-1959-47ba-9412-d668f793038a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:26.155843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-acb38071-1959-47ba-9412-d668f793038a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:26.156536 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-acb38071-1959-47ba-9412-d668f793038a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:26.157311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-acb38071-1959-47ba-9412-d668f793038a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:26.158026 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-acb38071-1959-47ba-9412-d668f793038a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:26.246698 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:26.256529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:26.259609 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:26.265225 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-db805891-7be3-446a-ab3f-b01142f905a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.214372 Jul 14 11:08:26.266482 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 99/194] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:26 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:26.302982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fd1efdab-3251-4166-b6c0-bcd3068ecf93 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:26.303631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fd1efdab-3251-4166-b6c0-bcd3068ecf93 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:26.311099 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd1efdab-3251-4166-b6c0-bcd3068ecf93 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:26.311587 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd1efdab-3251-4166-b6c0-bcd3068ecf93 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:26.312391 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd1efdab-3251-4166-b6c0-bcd3068ecf93 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:26.312828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd1efdab-3251-4166-b6c0-bcd3068ecf93 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:26.332046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-acb38071-1959-47ba-9412-d668f793038a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:26.347836 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-acb38071-1959-47ba-9412-d668f793038a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.203407 Jul 14 11:08:26.348897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 96/195] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:26 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:26.499505 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fd1efdab-3251-4166-b6c0-bcd3068ecf93 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:26.514577 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fd1efdab-3251-4166-b6c0-bcd3068ecf93 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.215237 Jul 14 11:08:26.515283 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 100/196] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:26 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:26.994944 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2ee7f43b-0eeb-442b-8b55-965be2d6ba49 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:26.995872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2ee7f43b-0eeb-442b-8b55-965be2d6ba49 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:27.002321 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee7f43b-0eeb-442b-8b55-965be2d6ba49 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:27.002772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee7f43b-0eeb-442b-8b55-965be2d6ba49 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:27.003642 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee7f43b-0eeb-442b-8b55-965be2d6ba49 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:27.004272 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee7f43b-0eeb-442b-8b55-965be2d6ba49 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:27.151374 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2ee7f43b-0eeb-442b-8b55-965be2d6ba49 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:27.159065 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2ee7f43b-0eeb-442b-8b55-965be2d6ba49 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.168117 Jul 14 11:08:27.159677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 97/197] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:26 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:27.298922 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:27.299520 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:27.306035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:27.307287 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:27.308333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:27.308924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:27.366515 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-144399f9-b247-4e94-b659-816e76f2f8cd tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:27.367134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-144399f9-b247-4e94-b659-816e76f2f8cd tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:27.374069 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-144399f9-b247-4e94-b659-816e76f2f8cd tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:27.375408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-144399f9-b247-4e94-b659-816e76f2f8cd tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:27.375408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-144399f9-b247-4e94-b659-816e76f2f8cd tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:27.375770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-144399f9-b247-4e94-b659-816e76f2f8cd tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:27.477701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:27.487504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:27.488998 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:27.490141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-66add6ff-2cb1-4467-9c6c-986e63d52df4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.196814 Jul 14 11:08:27.490694 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 101/198] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:27 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:27.529503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-144399f9-b247-4e94-b659-816e76f2f8cd tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:27.531965 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d58098f2-0ce7-43b8-b4e6-af9274c33665 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:27.532583 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d58098f2-0ce7-43b8-b4e6-af9274c33665 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:27.532979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:27.537998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-144399f9-b247-4e94-b659-816e76f2f8cd tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.175533 Jul 14 11:08:27.538516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 98/199] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:27 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:27.538992 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d58098f2-0ce7-43b8-b4e6-af9274c33665 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:27.539477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d58098f2-0ce7-43b8-b4e6-af9274c33665 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:27.540259 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d58098f2-0ce7-43b8-b4e6-af9274c33665 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:27.540694 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d58098f2-0ce7-43b8-b4e6-af9274c33665 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:27.672834 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d58098f2-0ce7-43b8-b4e6-af9274c33665 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:27.681528 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d58098f2-0ce7-43b8-b4e6-af9274c33665 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.153312 Jul 14 11:08:27.682585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 102/200] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:27 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:28.178217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f6887d56-8ad7-4bb9-8638-df3f520e6665 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:28.178825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f6887d56-8ad7-4bb9-8638-df3f520e6665 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:28.185992 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6887d56-8ad7-4bb9-8638-df3f520e6665 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:28.186451 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6887d56-8ad7-4bb9-8638-df3f520e6665 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:28.187208 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6887d56-8ad7-4bb9-8638-df3f520e6665 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:28.187668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6887d56-8ad7-4bb9-8638-df3f520e6665 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:28.316533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f6887d56-8ad7-4bb9-8638-df3f520e6665 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:28.324481 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f6887d56-8ad7-4bb9-8638-df3f520e6665 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.150156 Jul 14 11:08:28.325053 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 99/201] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:28 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:28.508766 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:28.509276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:28.516118 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:28.516566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:28.517336 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:28.517774 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:28.556121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a5d77a03-91d5-4c12-9edd-b6b97e765af3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:28.556863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a5d77a03-91d5-4c12-9edd-b6b97e765af3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:28.567323 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5d77a03-91d5-4c12-9edd-b6b97e765af3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:28.568546 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5d77a03-91d5-4c12-9edd-b6b97e765af3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:28.570155 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5d77a03-91d5-4c12-9edd-b6b97e765af3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:28.571068 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5d77a03-91d5-4c12-9edd-b6b97e765af3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:28.682593 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:28.690717 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:28.692309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:28.693420 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e6c1747-fc3c-4f79-a210-39c2fba0973c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.188653 Jul 14 11:08:28.693982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 103/202] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:28 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:28.698320 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ee0c285f-d05b-4a85-9821-1a81dc64d4b7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:28.698912 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ee0c285f-d05b-4a85-9821-1a81dc64d4b7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:28.704824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee0c285f-d05b-4a85-9821-1a81dc64d4b7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:28.705267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee0c285f-d05b-4a85-9821-1a81dc64d4b7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:28.706016 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee0c285f-d05b-4a85-9821-1a81dc64d4b7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:28.706440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee0c285f-d05b-4a85-9821-1a81dc64d4b7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:28.729185 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a5d77a03-91d5-4c12-9edd-b6b97e765af3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:28.736675 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a5d77a03-91d5-4c12-9edd-b6b97e765af3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.184581 Jul 14 11:08:28.737251 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 100/203] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:28 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:28.833594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee0c285f-d05b-4a85-9821-1a81dc64d4b7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:28.841117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ee0c285f-d05b-4a85-9821-1a81dc64d4b7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.146187 Jul 14 11:08:28.841684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 104/204] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:28 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:29.342012 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f7b5d7db-7462-4e67-b014-24cef3144a86 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:29.342652 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f7b5d7db-7462-4e67-b014-24cef3144a86 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:29.348847 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f7b5d7db-7462-4e67-b014-24cef3144a86 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:29.349299 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f7b5d7db-7462-4e67-b014-24cef3144a86 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:29.350068 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f7b5d7db-7462-4e67-b014-24cef3144a86 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:29.350550 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f7b5d7db-7462-4e67-b014-24cef3144a86 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:29.490330 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f7b5d7db-7462-4e67-b014-24cef3144a86 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:29.498083 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f7b5d7db-7462-4e67-b014-24cef3144a86 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.160598 Jul 14 11:08:29.498670 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 101/205] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:29 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:29.711407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:29.712029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:29.718821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:29.719375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:29.720384 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:29.720822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:29.754177 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d7dcd743-0bcd-4510-97e1-6d303b086e78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:29.754886 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d7dcd743-0bcd-4510-97e1-6d303b086e78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:29.769573 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7dcd743-0bcd-4510-97e1-6d303b086e78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:29.770027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7dcd743-0bcd-4510-97e1-6d303b086e78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:29.770804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7dcd743-0bcd-4510-97e1-6d303b086e78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:29.771239 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7dcd743-0bcd-4510-97e1-6d303b086e78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:29.873989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:29.882251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:29.883797 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:29.885518 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-577dc870-e51c-4975-9c5f-4a9aa05385ca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.177489 Jul 14 11:08:29.886091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 105/206] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:29 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:29.890616 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4e303fa-9e02-44d5-9224-82d8a961450e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:29.891227 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a4e303fa-9e02-44d5-9224-82d8a961450e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:29.897718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4e303fa-9e02-44d5-9224-82d8a961450e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:29.898174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4e303fa-9e02-44d5-9224-82d8a961450e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:29.898954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4e303fa-9e02-44d5-9224-82d8a961450e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:29.899420 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4e303fa-9e02-44d5-9224-82d8a961450e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:29.922657 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d7dcd743-0bcd-4510-97e1-6d303b086e78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:29.930624 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d7dcd743-0bcd-4510-97e1-6d303b086e78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.180312 Jul 14 11:08:29.931200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 102/207] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:29 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:30.035501 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a4e303fa-9e02-44d5-9224-82d8a961450e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:30.043499 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a4e303fa-9e02-44d5-9224-82d8a961450e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.156432 Jul 14 11:08:30.044073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 106/208] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:29 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:30.515602 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f1d97d33-b518-43e3-9af2-4f9f447f4c31 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:30.517901 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f1d97d33-b518-43e3-9af2-4f9f447f4c31 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:30.524603 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1d97d33-b518-43e3-9af2-4f9f447f4c31 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:30.525941 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1d97d33-b518-43e3-9af2-4f9f447f4c31 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:30.526962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1d97d33-b518-43e3-9af2-4f9f447f4c31 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:30.527879 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1d97d33-b518-43e3-9af2-4f9f447f4c31 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:30.694906 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f1d97d33-b518-43e3-9af2-4f9f447f4c31 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:30.702743 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f1d97d33-b518-43e3-9af2-4f9f447f4c31 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.191660 Jul 14 11:08:30.703324 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 103/209] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:30 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:30.903704 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:30.904338 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:30.910715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:30.911278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:30.912096 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:30.912529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:30.954340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e7f79557-aad2-4db0-982e-c5c09bea8fd3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:30.955243 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e7f79557-aad2-4db0-982e-c5c09bea8fd3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:30.961275 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7f79557-aad2-4db0-982e-c5c09bea8fd3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:30.961724 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7f79557-aad2-4db0-982e-c5c09bea8fd3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:30.962533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7f79557-aad2-4db0-982e-c5c09bea8fd3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:30.963608 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7f79557-aad2-4db0-982e-c5c09bea8fd3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:31.045266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:31.053335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:31.055106 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:31.056241 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ea4bd17f-ce34-45e7-9336-46346db8c21b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.157268 Jul 14 11:08:31.057014 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 107/210] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:30 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:31.061408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a3ef11a2-8fed-4af6-bba1-dcd3934de918 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:31.062156 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a3ef11a2-8fed-4af6-bba1-dcd3934de918 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:31.068070 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a3ef11a2-8fed-4af6-bba1-dcd3934de918 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:31.068519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a3ef11a2-8fed-4af6-bba1-dcd3934de918 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:31.069278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a3ef11a2-8fed-4af6-bba1-dcd3934de918 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:31.069712 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a3ef11a2-8fed-4af6-bba1-dcd3934de918 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:31.093203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e7f79557-aad2-4db0-982e-c5c09bea8fd3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:31.100827 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e7f79557-aad2-4db0-982e-c5c09bea8fd3 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.150360 Jul 14 11:08:31.101496 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 104/211] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:30 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:31.198376 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a3ef11a2-8fed-4af6-bba1-dcd3934de918 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:31.205903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a3ef11a2-8fed-4af6-bba1-dcd3934de918 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.147940 Jul 14 11:08:31.206499 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 108/212] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:31 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:31.719639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1e703451-f32a-4925-9b9c-05cd4cb6da89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:31.720234 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1e703451-f32a-4925-9b9c-05cd4cb6da89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:31.726252 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1e703451-f32a-4925-9b9c-05cd4cb6da89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:31.726690 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1e703451-f32a-4925-9b9c-05cd4cb6da89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:31.727464 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1e703451-f32a-4925-9b9c-05cd4cb6da89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:31.727893 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1e703451-f32a-4925-9b9c-05cd4cb6da89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:31.864620 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1e703451-f32a-4925-9b9c-05cd4cb6da89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:31.872718 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1e703451-f32a-4925-9b9c-05cd4cb6da89 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.157274 Jul 14 11:08:31.873292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 105/213] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:31 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:32.074097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:32.074705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:32.080779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:32.081224 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:32.081993 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:32.082430 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:32.118131 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c4007218-20cf-42ca-bb8e-cdfc4e74cda4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:32.118654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c4007218-20cf-42ca-bb8e-cdfc4e74cda4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:32.125160 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4007218-20cf-42ca-bb8e-cdfc4e74cda4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:32.125617 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4007218-20cf-42ca-bb8e-cdfc4e74cda4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:32.126405 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4007218-20cf-42ca-bb8e-cdfc4e74cda4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:32.126844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4007218-20cf-42ca-bb8e-cdfc4e74cda4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:32.226520 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:32.234921 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:32.236431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:32.237530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e6a352a0-e09d-4805-bdc5-324c7ccfe418 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.167392 Jul 14 11:08:32.238089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 109/214] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:32 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:32.243020 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6d6d9a86-9db4-47a9-80f8-62ac5ccb1aed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:32.243640 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6d6d9a86-9db4-47a9-80f8-62ac5ccb1aed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:32.249469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d6d9a86-9db4-47a9-80f8-62ac5ccb1aed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:32.249915 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d6d9a86-9db4-47a9-80f8-62ac5ccb1aed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:32.250671 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d6d9a86-9db4-47a9-80f8-62ac5ccb1aed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:32.251097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d6d9a86-9db4-47a9-80f8-62ac5ccb1aed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:32.272865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c4007218-20cf-42ca-bb8e-cdfc4e74cda4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:32.280963 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c4007218-20cf-42ca-bb8e-cdfc4e74cda4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.166799 Jul 14 11:08:32.281551 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 106/215] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:32 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:32.382899 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6d6d9a86-9db4-47a9-80f8-62ac5ccb1aed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:32.390313 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6d6d9a86-9db4-47a9-80f8-62ac5ccb1aed tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.150776 Jul 14 11:08:32.390879 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 110/216] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:32 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:32.889911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8bb783d6-589b-440f-834e-3f80e707334d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:32.890516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8bb783d6-589b-440f-834e-3f80e707334d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:32.896758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bb783d6-589b-440f-834e-3f80e707334d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:32.897300 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bb783d6-589b-440f-834e-3f80e707334d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:32.898135 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bb783d6-589b-440f-834e-3f80e707334d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:32.898564 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bb783d6-589b-440f-834e-3f80e707334d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:33.027370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8bb783d6-589b-440f-834e-3f80e707334d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:33.034839 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8bb783d6-589b-440f-834e-3f80e707334d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.148846 Jul 14 11:08:33.035510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 107/217] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:32 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:33.254742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:33.255344 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:33.261998 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:33.262450 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:33.263268 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:33.263729 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:33.301451 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-12fe7b6f-bbc4-41ac-9a20-bc4408755367 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:33.302532 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-12fe7b6f-bbc4-41ac-9a20-bc4408755367 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:33.312528 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-12fe7b6f-bbc4-41ac-9a20-bc4408755367 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:33.313338 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-12fe7b6f-bbc4-41ac-9a20-bc4408755367 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:33.314699 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-12fe7b6f-bbc4-41ac-9a20-bc4408755367 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:33.315516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-12fe7b6f-bbc4-41ac-9a20-bc4408755367 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:33.428014 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:33.437542 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:33.439079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:33.440277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b8ed82c3-7bcb-455d-86af-097c89b7353e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.189387 Jul 14 11:08:33.440857 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 111/218] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:33 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:33.445831 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c008e6d3-87ea-4666-9481-138c69475191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:33.446431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c008e6d3-87ea-4666-9481-138c69475191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:33.454254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c008e6d3-87ea-4666-9481-138c69475191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:33.454695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c008e6d3-87ea-4666-9481-138c69475191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:33.461050 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c008e6d3-87ea-4666-9481-138c69475191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:33.461555 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c008e6d3-87ea-4666-9481-138c69475191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:33.492238 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-12fe7b6f-bbc4-41ac-9a20-bc4408755367 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:33.500072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-12fe7b6f-bbc4-41ac-9a20-bc4408755367 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.205711 Jul 14 11:08:33.500667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 108/219] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:33 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:33.598839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c008e6d3-87ea-4666-9481-138c69475191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:33.606946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c008e6d3-87ea-4666-9481-138c69475191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.165100 Jul 14 11:08:33.607556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 112/220] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:33 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:34.051712 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-86716fe2-76b2-4906-affa-a32153ce7be8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:34.052350 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-86716fe2-76b2-4906-affa-a32153ce7be8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:34.058757 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86716fe2-76b2-4906-affa-a32153ce7be8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:34.059208 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86716fe2-76b2-4906-affa-a32153ce7be8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:34.060031 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86716fe2-76b2-4906-affa-a32153ce7be8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:34.060473 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86716fe2-76b2-4906-affa-a32153ce7be8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:34.192950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-86716fe2-76b2-4906-affa-a32153ce7be8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:34.201466 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-86716fe2-76b2-4906-affa-a32153ce7be8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.153553 Jul 14 11:08:34.202060 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 109/221] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:34 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:34.458345 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:34.458923 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:34.465374 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:34.465804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:34.466577 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:34.467017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:34.517250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eeb68980-5569-4b66-a419-1c4cc7cf685e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:34.517865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eeb68980-5569-4b66-a419-1c4cc7cf685e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:34.524033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eeb68980-5569-4b66-a419-1c4cc7cf685e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:34.524484 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eeb68980-5569-4b66-a419-1c4cc7cf685e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:34.525258 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eeb68980-5569-4b66-a419-1c4cc7cf685e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:34.525691 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eeb68980-5569-4b66-a419-1c4cc7cf685e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:34.625177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:34.640186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:34.643180 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:34.645232 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-855429fc-0302-4b79-a5a2-f87832b57963 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.190516 Jul 14 11:08:34.645929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 113/222] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:34 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:34.651795 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62aee4b8-e611-4350-8876-6a8b1612caf1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:34.652845 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62aee4b8-e611-4350-8876-6a8b1612caf1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:34.659647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62aee4b8-e611-4350-8876-6a8b1612caf1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:34.660166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62aee4b8-e611-4350-8876-6a8b1612caf1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:34.660922 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62aee4b8-e611-4350-8876-6a8b1612caf1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:34.661357 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62aee4b8-e611-4350-8876-6a8b1612caf1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:34.687332 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-eeb68980-5569-4b66-a419-1c4cc7cf685e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:34.695218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eeb68980-5569-4b66-a419-1c4cc7cf685e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.181869 Jul 14 11:08:34.695954 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 110/223] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:34 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:34.804748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62aee4b8-e611-4350-8876-6a8b1612caf1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:34.812901 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62aee4b8-e611-4350-8876-6a8b1612caf1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.165793 Jul 14 11:08:34.813485 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 114/224] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:34 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:35.218680 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7adb53eb-3d5c-4efa-946f-93f5bb89f3f6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:35.219284 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7adb53eb-3d5c-4efa-946f-93f5bb89f3f6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:35.225381 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7adb53eb-3d5c-4efa-946f-93f5bb89f3f6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:35.225830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7adb53eb-3d5c-4efa-946f-93f5bb89f3f6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:35.226597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7adb53eb-3d5c-4efa-946f-93f5bb89f3f6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:35.227063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7adb53eb-3d5c-4efa-946f-93f5bb89f3f6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:35.363701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7adb53eb-3d5c-4efa-946f-93f5bb89f3f6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:35.371962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7adb53eb-3d5c-4efa-946f-93f5bb89f3f6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.157118 Jul 14 11:08:35.372538 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 111/225] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:35 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:35.663365 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:35.663987 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:35.670017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:35.670456 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:35.671204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:35.671666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:35.689915 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:35.712063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6a80ab5b-b51b-4865-8c2e-3d4a63411c46 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:35.712668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6a80ab5b-b51b-4865-8c2e-3d4a63411c46 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:35.718518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a80ab5b-b51b-4865-8c2e-3d4a63411c46 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:35.719004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a80ab5b-b51b-4865-8c2e-3d4a63411c46 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:35.719741 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a80ab5b-b51b-4865-8c2e-3d4a63411c46 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:35.720182 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a80ab5b-b51b-4865-8c2e-3d4a63411c46 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:35.804040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:35.815408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:35.817022 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:35.818210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4958cb7d-f009-4527-835d-70ce37ec7057 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.158725 Jul 14 11:08:35.819074 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 115/226] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:35 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:35.833918 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ae4fe5c-626d-463e-8257-5f60dbabc6e8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:35.834530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4ae4fe5c-626d-463e-8257-5f60dbabc6e8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:35.841444 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ae4fe5c-626d-463e-8257-5f60dbabc6e8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:35.841898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ae4fe5c-626d-463e-8257-5f60dbabc6e8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:35.842669 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ae4fe5c-626d-463e-8257-5f60dbabc6e8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:35.843103 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ae4fe5c-626d-463e-8257-5f60dbabc6e8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:35.867257 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6a80ab5b-b51b-4865-8c2e-3d4a63411c46 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:35.875670 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6a80ab5b-b51b-4865-8c2e-3d4a63411c46 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.167239 Jul 14 11:08:35.876453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 112/227] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:35 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:35.983556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ae4fe5c-626d-463e-8257-5f60dbabc6e8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:35.990892 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4ae4fe5c-626d-463e-8257-5f60dbabc6e8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.160712 Jul 14 11:08:35.991475 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 116/228] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:35 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:36.389277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-09c018ff-9c71-4ae6-b424-54102b1e4518 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:36.390074 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-09c018ff-9c71-4ae6-b424-54102b1e4518 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:36.396273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-09c018ff-9c71-4ae6-b424-54102b1e4518 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:36.396718 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-09c018ff-9c71-4ae6-b424-54102b1e4518 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:36.397487 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-09c018ff-9c71-4ae6-b424-54102b1e4518 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:36.397921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-09c018ff-9c71-4ae6-b424-54102b1e4518 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:36.532800 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-09c018ff-9c71-4ae6-b424-54102b1e4518 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:36.540320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-09c018ff-9c71-4ae6-b424-54102b1e4518 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.154900 Jul 14 11:08:36.541569 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 113/229] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:36 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:36.836344 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:36.837164 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:36.843978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:36.844432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:36.845218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:36.845663 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:36.893344 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-89d46297-12dd-42ae-96bd-b25f16329b78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:36.894042 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-89d46297-12dd-42ae-96bd-b25f16329b78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:36.900105 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-89d46297-12dd-42ae-96bd-b25f16329b78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:36.901095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-89d46297-12dd-42ae-96bd-b25f16329b78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:36.901854 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-89d46297-12dd-42ae-96bd-b25f16329b78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:36.902280 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-89d46297-12dd-42ae-96bd-b25f16329b78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:36.983952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:36.993218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:36.994831 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:36.996281 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-85a1125c-8bd4-4bde-993f-7453bca8fbe5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.163831 Jul 14 11:08:36.996909 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 117/230] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:36 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:08:37.014701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e1fa1e92-8ce8-4d19-a5bb-f182fdc60ee6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:37.015313 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e1fa1e92-8ce8-4d19-a5bb-f182fdc60ee6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:37.021557 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e1fa1e92-8ce8-4d19-a5bb-f182fdc60ee6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:37.022011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e1fa1e92-8ce8-4d19-a5bb-f182fdc60ee6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:37.022791 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e1fa1e92-8ce8-4d19-a5bb-f182fdc60ee6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:37.023228 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e1fa1e92-8ce8-4d19-a5bb-f182fdc60ee6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:37.042494 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-89d46297-12dd-42ae-96bd-b25f16329b78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:37.050190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-89d46297-12dd-42ae-96bd-b25f16329b78 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.160798 Jul 14 11:08:37.050896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 114/231] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:36 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:37.158626 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e1fa1e92-8ce8-4d19-a5bb-f182fdc60ee6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:37.166724 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e1fa1e92-8ce8-4d19-a5bb-f182fdc60ee6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.155800 Jul 14 11:08:37.167408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 118/232] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:37 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:37.558761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0491a354-ab73-4670-93e6-4d6c1338a65c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:37.559544 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0491a354-ab73-4670-93e6-4d6c1338a65c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:37.565678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0491a354-ab73-4670-93e6-4d6c1338a65c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:37.566131 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0491a354-ab73-4670-93e6-4d6c1338a65c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:37.566910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0491a354-ab73-4670-93e6-4d6c1338a65c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:37.567351 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0491a354-ab73-4670-93e6-4d6c1338a65c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:37.586205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:37.614528 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e21e9bf4-f14a-4ca7-8762-83d542c7337f req-0e71084f-11f2-4e20-922a-13a6581c0206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9966b0a3-56f9-486d-99ba-0e616d15167a", "name": "network-vif-plugged", "status": "completed", "tag": "60ab608d-54a2-43be-9f6e-4c5078b5c6b4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:37.624268 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e21e9bf4-f14a-4ca7-8762-83d542c7337f req-0e71084f-11f2-4e20-922a-13a6581c0206 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:37.624961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e21e9bf4-f14a-4ca7-8762-83d542c7337f req-0e71084f-11f2-4e20-922a-13a6581c0206 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:37.639399 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e21e9bf4-f14a-4ca7-8762-83d542c7337f req-0e71084f-11f2-4e20-922a-13a6581c0206 service nova] Creating event network-vif-plugged:60ab608d-54a2-43be-9f6e-4c5078b5c6b4 for instance 9966b0a3-56f9-486d-99ba-0e616d15167a on hv-cinder-84893 Jul 14 11:08:37.644930 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e21e9bf4-f14a-4ca7-8762-83d542c7337f req-0e71084f-11f2-4e20-922a-13a6581c0206 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034546 Jul 14 11:08:37.645768 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 119/233] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:08:37.717756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0491a354-ab73-4670-93e6-4d6c1338a65c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:37.725526 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0491a354-ab73-4670-93e6-4d6c1338a65c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.171486 Jul 14 11:08:37.735003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 115/234] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:37 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:38.017194 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:38.017900 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:38.024114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:38.024569 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:38.025850 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:38.026288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:38.067906 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b9770558-74d8-4da3-af04-4299f9c13889 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:38.068485 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b9770558-74d8-4da3-af04-4299f9c13889 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:38.075543 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b9770558-74d8-4da3-af04-4299f9c13889 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:38.075996 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b9770558-74d8-4da3-af04-4299f9c13889 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:38.076985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b9770558-74d8-4da3-af04-4299f9c13889 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:38.077429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b9770558-74d8-4da3-af04-4299f9c13889 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:38.177660 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:38.189737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:38.193655 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:38.195186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-15c3c1d4-e629-4c7c-9340-86c1f834d121 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.181990 Jul 14 11:08:38.197045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 120/235] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:38 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:38.205527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1fe562c7-eb7e-4708-9513-333e6b6f37df tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:38.206534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1fe562c7-eb7e-4708-9513-333e6b6f37df tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:38.215794 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fe562c7-eb7e-4708-9513-333e6b6f37df tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:38.216456 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fe562c7-eb7e-4708-9513-333e6b6f37df tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:38.217369 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fe562c7-eb7e-4708-9513-333e6b6f37df tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:38.217903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fe562c7-eb7e-4708-9513-333e6b6f37df tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:38.250533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b9770558-74d8-4da3-af04-4299f9c13889 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:38.260145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b9770558-74d8-4da3-af04-4299f9c13889 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.195608 Jul 14 11:08:38.261170 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 116/236] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:38 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:38.360817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1fe562c7-eb7e-4708-9513-333e6b6f37df tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:38.369867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1fe562c7-eb7e-4708-9513-333e6b6f37df tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.170626 Jul 14 11:08:38.370652 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 121/237] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:38 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:38.742650 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9a709758-f667-453b-a084-bd634ec82448 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:38.743289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9a709758-f667-453b-a084-bd634ec82448 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:38.749744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a709758-f667-453b-a084-bd634ec82448 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:38.750211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a709758-f667-453b-a084-bd634ec82448 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:38.750963 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a709758-f667-453b-a084-bd634ec82448 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:38.751413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a709758-f667-453b-a084-bd634ec82448 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:38.885966 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9a709758-f667-453b-a084-bd634ec82448 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:38.893818 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9a709758-f667-453b-a084-bd634ec82448 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.154931 Jul 14 11:08:38.894415 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 117/238] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:38 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:39.217170 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:39.218199 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:39.224474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:39.224931 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:39.225717 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:39.226151 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:39.280297 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b6b02083-a1c1-44d9-b956-5f58b2e43deb tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:39.280997 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b6b02083-a1c1-44d9-b956-5f58b2e43deb tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:39.290248 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6b02083-a1c1-44d9-b956-5f58b2e43deb tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:39.291534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6b02083-a1c1-44d9-b956-5f58b2e43deb tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:39.292418 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6b02083-a1c1-44d9-b956-5f58b2e43deb tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:39.292955 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6b02083-a1c1-44d9-b956-5f58b2e43deb tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:39.381029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:39.389090 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:39.390590 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:39.391738 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6e2a1e74-28b6-46aa-a7b3-af6fcce1fc3d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.181415 Jul 14 11:08:39.392310 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 122/239] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:39 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:39.396826 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-764024d5-53ea-4b7b-bb31-f4412ec141d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:39.397435 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-764024d5-53ea-4b7b-bb31-f4412ec141d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:39.404279 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-764024d5-53ea-4b7b-bb31-f4412ec141d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:39.404730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-764024d5-53ea-4b7b-bb31-f4412ec141d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:39.405502 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-764024d5-53ea-4b7b-bb31-f4412ec141d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:39.405939 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-764024d5-53ea-4b7b-bb31-f4412ec141d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:39.432838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b6b02083-a1c1-44d9-b956-5f58b2e43deb tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:39.440689 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b6b02083-a1c1-44d9-b956-5f58b2e43deb tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.164220 Jul 14 11:08:39.441190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 118/240] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:39 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:39.550169 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-764024d5-53ea-4b7b-bb31-f4412ec141d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:39.558075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-764024d5-53ea-4b7b-bb31-f4412ec141d7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.164783 Jul 14 11:08:39.558662 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 123/241] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:39 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:39.910744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7f2ed9ea-c26e-4b8d-aeb9-b103f088ab8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:39.911352 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7f2ed9ea-c26e-4b8d-aeb9-b103f088ab8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:39.917633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f2ed9ea-c26e-4b8d-aeb9-b103f088ab8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:39.918076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f2ed9ea-c26e-4b8d-aeb9-b103f088ab8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:39.918842 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f2ed9ea-c26e-4b8d-aeb9-b103f088ab8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:39.919274 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f2ed9ea-c26e-4b8d-aeb9-b103f088ab8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:40.056266 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7f2ed9ea-c26e-4b8d-aeb9-b103f088ab8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:40.064249 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7f2ed9ea-c26e-4b8d-aeb9-b103f088ab8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.157282 Jul 14 11:08:40.064826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 119/242] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:39 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:40.410657 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:40.411359 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:40.417626 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:40.418073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:40.418837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:40.419266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:40.457476 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-59a4045a-f7b4-42d3-a2f9-08aaf0e0b67d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:40.458001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-59a4045a-f7b4-42d3-a2f9-08aaf0e0b67d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:40.467595 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-59a4045a-f7b4-42d3-a2f9-08aaf0e0b67d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:40.469653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-59a4045a-f7b4-42d3-a2f9-08aaf0e0b67d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:40.469653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-59a4045a-f7b4-42d3-a2f9-08aaf0e0b67d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:40.472884 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-59a4045a-f7b4-42d3-a2f9-08aaf0e0b67d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:40.574989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:40.584112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:40.585748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:40.587100 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f04ad587-672c-40ac-929f-bcfad49544c8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.180408 Jul 14 11:08:40.587753 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 124/243] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:40 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:40.592582 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7d8ea93d-f228-4b01-8750-31a4fc6f6992 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:40.593402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7d8ea93d-f228-4b01-8750-31a4fc6f6992 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:40.599983 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d8ea93d-f228-4b01-8750-31a4fc6f6992 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:40.600435 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d8ea93d-f228-4b01-8750-31a4fc6f6992 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:40.601415 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d8ea93d-f228-4b01-8750-31a4fc6f6992 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:40.601851 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d8ea93d-f228-4b01-8750-31a4fc6f6992 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:40.648512 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-59a4045a-f7b4-42d3-a2f9-08aaf0e0b67d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:40.656795 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-59a4045a-f7b4-42d3-a2f9-08aaf0e0b67d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.203183 Jul 14 11:08:40.657377 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 120/244] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:40 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:40.739919 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7d8ea93d-f228-4b01-8750-31a4fc6f6992 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:40.748181 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7d8ea93d-f228-4b01-8750-31a4fc6f6992 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.159193 Jul 14 11:08:40.748771 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 125/245] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:40 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:41.085165 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2413d9c5-5857-4da1-993f-da6f1a1a7d9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:41.085165 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2413d9c5-5857-4da1-993f-da6f1a1a7d9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:41.089754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2413d9c5-5857-4da1-993f-da6f1a1a7d9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:41.090199 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2413d9c5-5857-4da1-993f-da6f1a1a7d9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:41.090966 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2413d9c5-5857-4da1-993f-da6f1a1a7d9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:41.091406 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2413d9c5-5857-4da1-993f-da6f1a1a7d9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:41.225329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2413d9c5-5857-4da1-993f-da6f1a1a7d9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:41.234241 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2413d9c5-5857-4da1-993f-da6f1a1a7d9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.156232 Jul 14 11:08:41.235135 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 121/246] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:41 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:41.605958 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:41.606752 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:41.612833 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:41.613282 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:41.614043 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:41.614478 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:41.674608 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ab773f5f-fdbe-4e22-8c91-0f4ec50d5d53 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:41.675221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ab773f5f-fdbe-4e22-8c91-0f4ec50d5d53 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:41.682399 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab773f5f-fdbe-4e22-8c91-0f4ec50d5d53 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:41.683008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab773f5f-fdbe-4e22-8c91-0f4ec50d5d53 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:41.683892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab773f5f-fdbe-4e22-8c91-0f4ec50d5d53 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:41.684333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab773f5f-fdbe-4e22-8c91-0f4ec50d5d53 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:41.755326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:41.763736 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:41.765245 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:41.766393 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ed989e3c-cf9d-4ef3-9573-b7ac71e3a781 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.164975 Jul 14 11:08:41.766937 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 126/247] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:41 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:41.771317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2679f5e1-548a-4d61-98a6-47e8f75565ec tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:41.772007 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2679f5e1-548a-4d61-98a6-47e8f75565ec tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:41.779050 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2679f5e1-548a-4d61-98a6-47e8f75565ec tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:41.779553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2679f5e1-548a-4d61-98a6-47e8f75565ec tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:41.780333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2679f5e1-548a-4d61-98a6-47e8f75565ec tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:41.780991 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2679f5e1-548a-4d61-98a6-47e8f75565ec tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:41.829068 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ab773f5f-fdbe-4e22-8c91-0f4ec50d5d53 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:41.836809 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ab773f5f-fdbe-4e22-8c91-0f4ec50d5d53 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.166156 Jul 14 11:08:41.837417 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 122/248] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:41 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:41.918090 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2679f5e1-548a-4d61-98a6-47e8f75565ec tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:41.925987 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2679f5e1-548a-4d61-98a6-47e8f75565ec tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.158015 Jul 14 11:08:41.926571 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 127/249] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:41 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:42.264191 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-462a9927-ba26-43e9-b4cd-ece00ace32af tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:42.266179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-462a9927-ba26-43e9-b4cd-ece00ace32af tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:42.277057 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-462a9927-ba26-43e9-b4cd-ece00ace32af tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:42.277786 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-462a9927-ba26-43e9-b4cd-ece00ace32af tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:42.279229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-462a9927-ba26-43e9-b4cd-ece00ace32af tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:42.279785 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-462a9927-ba26-43e9-b4cd-ece00ace32af tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:42.481509 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-462a9927-ba26-43e9-b4cd-ece00ace32af tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:42.489593 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-462a9927-ba26-43e9-b4cd-ece00ace32af tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.234004 Jul 14 11:08:42.490486 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 123/250] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:42 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:42.785324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:42.785956 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:42.792705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:42.793159 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:42.793935 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:42.794374 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:42.856510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8c12b4a4-ccc5-42ed-adcb-af69432fba40 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:42.857615 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8c12b4a4-ccc5-42ed-adcb-af69432fba40 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:42.868467 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c12b4a4-ccc5-42ed-adcb-af69432fba40 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:42.869827 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c12b4a4-ccc5-42ed-adcb-af69432fba40 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:42.871425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c12b4a4-ccc5-42ed-adcb-af69432fba40 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:42.872167 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c12b4a4-ccc5-42ed-adcb-af69432fba40 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:42.956689 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:42.966706 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:42.968815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:42.970603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a67ebba1-9a86-47fc-9c01-dba8a8e02f10 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.189245 Jul 14 11:08:42.971343 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 128/251] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:42 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:42.979407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-704fbbe1-92f9-42db-bb36-b5c864b8a350 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:42.980805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-704fbbe1-92f9-42db-bb36-b5c864b8a350 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:42.989197 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-704fbbe1-92f9-42db-bb36-b5c864b8a350 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:42.989630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-704fbbe1-92f9-42db-bb36-b5c864b8a350 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:42.990407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-704fbbe1-92f9-42db-bb36-b5c864b8a350 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:42.990837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-704fbbe1-92f9-42db-bb36-b5c864b8a350 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:43.054138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8c12b4a4-ccc5-42ed-adcb-af69432fba40 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:43.062862 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8c12b4a4-ccc5-42ed-adcb-af69432fba40 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.212706 Jul 14 11:08:43.063466 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 124/252] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:42 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:43.129614 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-704fbbe1-92f9-42db-bb36-b5c864b8a350 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:43.138415 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-704fbbe1-92f9-42db-bb36-b5c864b8a350 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.165701 Jul 14 11:08:43.138947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 129/253] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:42 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:43.517178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d3b4f01c-6971-4412-9a99-a1dc28f05791 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:43.518617 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d3b4f01c-6971-4412-9a99-a1dc28f05791 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:43.528635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3b4f01c-6971-4412-9a99-a1dc28f05791 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:43.529275 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3b4f01c-6971-4412-9a99-a1dc28f05791 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:43.530407 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3b4f01c-6971-4412-9a99-a1dc28f05791 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:43.530989 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3b4f01c-6971-4412-9a99-a1dc28f05791 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:43.786984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d3b4f01c-6971-4412-9a99-a1dc28f05791 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:43.811824 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d3b4f01c-6971-4412-9a99-a1dc28f05791 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.299218 Jul 14 11:08:43.832304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 125/254] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:43 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:43.998218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:43.999552 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:44.069197 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:44.069982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:44.090524 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:44.090524 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:44.091361 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-61146d3d-6544-46b4-b7fb-a3907c3bac88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:44.091361 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-61146d3d-6544-46b4-b7fb-a3907c3bac88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:44.116039 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61146d3d-6544-46b4-b7fb-a3907c3bac88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:44.120529 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61146d3d-6544-46b4-b7fb-a3907c3bac88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:44.131699 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61146d3d-6544-46b4-b7fb-a3907c3bac88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:44.137015 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61146d3d-6544-46b4-b7fb-a3907c3bac88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:44.924086 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-61146d3d-6544-46b4-b7fb-a3907c3bac88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:44.945202 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-61146d3d-6544-46b4-b7fb-a3907c3bac88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.865707 Jul 14 11:08:44.946200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 126/255] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:44 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:44.951194 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1f3ef649-9c2d-416c-8f88-d085d36a8a5b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:44.951928 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1f3ef649-9c2d-416c-8f88-d085d36a8a5b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:44.959602 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1f3ef649-9c2d-416c-8f88-d085d36a8a5b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:44.960144 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1f3ef649-9c2d-416c-8f88-d085d36a8a5b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:44.960932 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1f3ef649-9c2d-416c-8f88-d085d36a8a5b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:44.961372 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1f3ef649-9c2d-416c-8f88-d085d36a8a5b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:45.076546 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:45.089536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:45.091048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:45.092580 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b4d1ba06-b7a3-4bbe-9af0-e1cee1a14e77 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 1.104386 Jul 14 11:08:45.093150 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 130/256] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:43 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:45.098113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-44018128-32d4-4300-986f-971e4841f3c0 req-4cd08d7a-3608-4a16-8744-bd83bf1f44bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb87b2e-2f5d-429a-95a9-1af62edd1e2b", "name": "network-vif-plugged", "status": "completed", "tag": "13944c62-ebab-45c6-93d8-38bb5fd3a687"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:45.108131 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-44018128-32d4-4300-986f-971e4841f3c0 req-4cd08d7a-3608-4a16-8744-bd83bf1f44bb service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:45.108941 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-44018128-32d4-4300-986f-971e4841f3c0 req-4cd08d7a-3608-4a16-8744-bd83bf1f44bb service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:45.122067 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-44018128-32d4-4300-986f-971e4841f3c0 req-4cd08d7a-3608-4a16-8744-bd83bf1f44bb service nova] Creating event network-vif-plugged:13944c62-ebab-45c6-93d8-38bb5fd3a687 for instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b on hv-cinder-84893 Jul 14 11:08:45.127877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-44018128-32d4-4300-986f-971e4841f3c0 req-4cd08d7a-3608-4a16-8744-bd83bf1f44bb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Jul 14 11:08:45.128483 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 131/257] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:08:45.135056 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b7309fd2-5f39-4356-b89f-7e7aa17eb927 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:45.135794 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b7309fd2-5f39-4356-b89f-7e7aa17eb927 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:45.142775 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7309fd2-5f39-4356-b89f-7e7aa17eb927 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:45.143280 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7309fd2-5f39-4356-b89f-7e7aa17eb927 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:45.144103 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7309fd2-5f39-4356-b89f-7e7aa17eb927 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:45.144533 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7309fd2-5f39-4356-b89f-7e7aa17eb927 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:45.656843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1f3ef649-9c2d-416c-8f88-d085d36a8a5b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:45.668285 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1f3ef649-9c2d-416c-8f88-d085d36a8a5b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.720871 Jul 14 11:08:45.669611 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 127/258] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:44 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:45.711166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b7309fd2-5f39-4356-b89f-7e7aa17eb927 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:45.730502 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b7309fd2-5f39-4356-b89f-7e7aa17eb927 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.600528 Jul 14 11:08:45.731286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 132/259] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:45 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:45.964070 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-61ad86b5-50af-48a0-b4c2-a11eaeb8ea6a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:45.965383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-61ad86b5-50af-48a0-b4c2-a11eaeb8ea6a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:45.978305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61ad86b5-50af-48a0-b4c2-a11eaeb8ea6a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:45.979482 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61ad86b5-50af-48a0-b4c2-a11eaeb8ea6a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:45.980546 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61ad86b5-50af-48a0-b4c2-a11eaeb8ea6a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:45.983099 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61ad86b5-50af-48a0-b4c2-a11eaeb8ea6a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:46.122051 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:46.122941 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:46.136028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:46.136582 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:46.138004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:46.139193 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:46.190133 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:46.233785 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-61ad86b5-50af-48a0-b4c2-a11eaeb8ea6a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:46.244201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-61ad86b5-50af-48a0-b4c2-a11eaeb8ea6a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.283930 Jul 14 11:08:46.245128 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 128/260] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:45 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:46.462995 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:46.481857 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:46.488424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:46.493110 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c86ef7f4-ab21-4fab-9970-6e3d498c0e13 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.377215 Jul 14 11:08:46.498934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 133/261] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:46 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:08:46.701964 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2a125a53-12c2-4b8a-b382-f6eb4c0917db tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:46.704722 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2a125a53-12c2-4b8a-b382-f6eb4c0917db tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:46.723694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:46.727250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a125a53-12c2-4b8a-b382-f6eb4c0917db tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:46.728943 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a125a53-12c2-4b8a-b382-f6eb4c0917db tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:46.730707 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a125a53-12c2-4b8a-b382-f6eb4c0917db tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:46.732775 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a125a53-12c2-4b8a-b382-f6eb4c0917db tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:46.774880 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f4fba4f5-4e90-466a-9f30-9d10ee9b6b34 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:46.777272 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f4fba4f5-4e90-466a-9f30-9d10ee9b6b34 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:46.794945 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4fba4f5-4e90-466a-9f30-9d10ee9b6b34 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:46.796163 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4fba4f5-4e90-466a-9f30-9d10ee9b6b34 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:46.798058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4fba4f5-4e90-466a-9f30-9d10ee9b6b34 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:46.798841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4fba4f5-4e90-466a-9f30-9d10ee9b6b34 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:47.075622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f4fba4f5-4e90-466a-9f30-9d10ee9b6b34 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:47.085392 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f4fba4f5-4e90-466a-9f30-9d10ee9b6b34 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.338502 Jul 14 11:08:47.085985 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 134/262] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:46 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:47.137961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2a125a53-12c2-4b8a-b382-f6eb4c0917db tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:47.146447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2a125a53-12c2-4b8a-b382-f6eb4c0917db tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.459220 Jul 14 11:08:47.147040 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 129/263] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:46 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:47.262049 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1f9fdbf2-b571-437a-a712-432d8eb2bb15 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:47.262646 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1f9fdbf2-b571-437a-a712-432d8eb2bb15 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:47.269146 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f9fdbf2-b571-437a-a712-432d8eb2bb15 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:47.269590 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f9fdbf2-b571-437a-a712-432d8eb2bb15 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:47.270365 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f9fdbf2-b571-437a-a712-432d8eb2bb15 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:47.270793 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f9fdbf2-b571-437a-a712-432d8eb2bb15 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:47.416010 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1f9fdbf2-b571-437a-a712-432d8eb2bb15 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:47.425986 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1f9fdbf2-b571-437a-a712-432d8eb2bb15 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.168354 Jul 14 11:08:47.431779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 135/264] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:47 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:47.545693 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:47.546410 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:47.558263 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:47.559413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:47.561163 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:47.562147 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:47.806410 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:47.823186 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:47.826640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:47.829116 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2dc754d8-0d1a-49e1-9591-77f29d790681 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.305835 Jul 14 11:08:47.830170 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 130/265] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:47 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:48.117636 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a41e3dac-2f0d-4003-9db2-97c8802ff0db tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:48.119304 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a41e3dac-2f0d-4003-9db2-97c8802ff0db tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:48.131281 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a41e3dac-2f0d-4003-9db2-97c8802ff0db tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:48.132102 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a41e3dac-2f0d-4003-9db2-97c8802ff0db tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:48.133438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a41e3dac-2f0d-4003-9db2-97c8802ff0db tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:48.134250 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a41e3dac-2f0d-4003-9db2-97c8802ff0db tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:48.172663 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a4904bb3-3403-4a5e-8f7a-5a353ba6edc5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:48.173461 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a4904bb3-3403-4a5e-8f7a-5a353ba6edc5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:48.180594 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a4904bb3-3403-4a5e-8f7a-5a353ba6edc5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:48.181801 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a4904bb3-3403-4a5e-8f7a-5a353ba6edc5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:48.182832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a4904bb3-3403-4a5e-8f7a-5a353ba6edc5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:48.183488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a4904bb3-3403-4a5e-8f7a-5a353ba6edc5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:48.390096 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a41e3dac-2f0d-4003-9db2-97c8802ff0db tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:48.401813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a41e3dac-2f0d-4003-9db2-97c8802ff0db tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.291322 Jul 14 11:08:48.403592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 136/266] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:48 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:48.415682 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a4904bb3-3403-4a5e-8f7a-5a353ba6edc5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:48.421437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a4904bb3-3403-4a5e-8f7a-5a353ba6edc5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.252088 Jul 14 11:08:48.422010 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 131/267] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:48 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:48.443744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dbcc8b28-89d8-4cc6-be92-a4fc01baef4c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:48.444585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dbcc8b28-89d8-4cc6-be92-a4fc01baef4c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:48.451650 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbcc8b28-89d8-4cc6-be92-a4fc01baef4c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:48.452106 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbcc8b28-89d8-4cc6-be92-a4fc01baef4c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:48.452892 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbcc8b28-89d8-4cc6-be92-a4fc01baef4c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:48.453348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbcc8b28-89d8-4cc6-be92-a4fc01baef4c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:48.617543 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dbcc8b28-89d8-4cc6-be92-a4fc01baef4c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:48.625849 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dbcc8b28-89d8-4cc6-be92-a4fc01baef4c tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.186092 Jul 14 11:08:48.626432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 137/268] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:48 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:48.858470 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:48.859682 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:48.867295 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:48.867851 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:48.869330 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:48.870219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:48.876006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:49.076427 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:49.088325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:49.090194 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:49.091444 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bcc946fc-d7b3-41f2-9065-14cacdf0f69b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.237523 Jul 14 11:08:49.092156 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 132/269] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:48 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:49.428171 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7f1d4bea-fa2b-4230-b81a-bd8868fdaf9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:49.428814 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7f1d4bea-fa2b-4230-b81a-bd8868fdaf9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:49.436385 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f1d4bea-fa2b-4230-b81a-bd8868fdaf9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:49.436928 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f1d4bea-fa2b-4230-b81a-bd8868fdaf9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:49.437833 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f1d4bea-fa2b-4230-b81a-bd8868fdaf9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:49.438396 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f1d4bea-fa2b-4230-b81a-bd8868fdaf9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:49.439414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-638545c8-bbaf-40d2-ab87-61acb46129c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:49.440338 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-638545c8-bbaf-40d2-ab87-61acb46129c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:49.448121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-638545c8-bbaf-40d2-ab87-61acb46129c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:49.448622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-638545c8-bbaf-40d2-ab87-61acb46129c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:49.449448 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-638545c8-bbaf-40d2-ab87-61acb46129c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:49.449933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-638545c8-bbaf-40d2-ab87-61acb46129c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:49.615820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-638545c8-bbaf-40d2-ab87-61acb46129c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:49.624801 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-638545c8-bbaf-40d2-ab87-61acb46129c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.190358 Jul 14 11:08:49.626004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 133/270] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:49 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:49.629261 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7f1d4bea-fa2b-4230-b81a-bd8868fdaf9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:49.642806 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7f1d4bea-fa2b-4230-b81a-bd8868fdaf9d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.218329 Jul 14 11:08:49.643430 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 138/271] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:49 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:49.656672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e6809b05-4d83-4072-8247-dbf0cd60f50d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:49.657765 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e6809b05-4d83-4072-8247-dbf0cd60f50d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:49.664663 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6809b05-4d83-4072-8247-dbf0cd60f50d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:49.665195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6809b05-4d83-4072-8247-dbf0cd60f50d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:49.666010 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6809b05-4d83-4072-8247-dbf0cd60f50d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:49.666548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6809b05-4d83-4072-8247-dbf0cd60f50d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:49.802551 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e6809b05-4d83-4072-8247-dbf0cd60f50d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:49.813393 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e6809b05-4d83-4072-8247-dbf0cd60f50d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.165053 Jul 14 11:08:49.814037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 134/272] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:49 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:50.110554 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:50.111138 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:50.118431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:50.118867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:50.119721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:50.120162 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:50.291830 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:50.302270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:50.303897 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:50.305347 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b5cb0ad3-4598-4e4a-a9e7-bf8b0a577c0a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.199021 Jul 14 11:08:50.306685 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 139/273] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:50 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:50.643035 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ce7f59a6-f27d-45b7-8624-a6e1ed5b4772 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:50.643723 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ce7f59a6-f27d-45b7-8624-a6e1ed5b4772 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:50.651189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ce7f59a6-f27d-45b7-8624-a6e1ed5b4772 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:50.651730 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ce7f59a6-f27d-45b7-8624-a6e1ed5b4772 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:50.652707 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ce7f59a6-f27d-45b7-8624-a6e1ed5b4772 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:50.653199 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ce7f59a6-f27d-45b7-8624-a6e1ed5b4772 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:50.668269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-04d7af2f-3cb8-4a18-9076-594ee8f9f861 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:50.669269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-04d7af2f-3cb8-4a18-9076-594ee8f9f861 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:50.677318 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04d7af2f-3cb8-4a18-9076-594ee8f9f861 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:50.677951 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04d7af2f-3cb8-4a18-9076-594ee8f9f861 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:50.678943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04d7af2f-3cb8-4a18-9076-594ee8f9f861 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:50.679826 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04d7af2f-3cb8-4a18-9076-594ee8f9f861 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:50.845961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ce7f59a6-f27d-45b7-8624-a6e1ed5b4772 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:50.860511 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ce7f59a6-f27d-45b7-8624-a6e1ed5b4772 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.221144 Jul 14 11:08:50.861626 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 135/274] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:50 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:50.868089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-04d7af2f-3cb8-4a18-9076-594ee8f9f861 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:50.870729 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eada09bd-61b5-455c-bf48-ac3aab937553 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:50.872164 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eada09bd-61b5-455c-bf48-ac3aab937553 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:50.881041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-04d7af2f-3cb8-4a18-9076-594ee8f9f861 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.217697 Jul 14 11:08:50.881894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 140/275] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:50 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:50.888551 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eada09bd-61b5-455c-bf48-ac3aab937553 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:50.889901 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eada09bd-61b5-455c-bf48-ac3aab937553 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:50.891331 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eada09bd-61b5-455c-bf48-ac3aab937553 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:50.892143 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eada09bd-61b5-455c-bf48-ac3aab937553 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:51.048591 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-eada09bd-61b5-455c-bf48-ac3aab937553 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:51.057448 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eada09bd-61b5-455c-bf48-ac3aab937553 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.194320 Jul 14 11:08:51.058044 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 136/276] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:50 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:51.325236 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:51.326061 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:51.327992 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:51.333372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:51.333826 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:51.334610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:51.335066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:51.495804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:51.504489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:51.505988 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:51.507092 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-04dd2ecb-10ff-42aa-a205-4d5fb4ba2a1f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.186634 Jul 14 11:08:51.507695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 141/277] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:51 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:51.886143 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-088e7c7f-050a-48ae-8d59-c3fa1756a17b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:51.886770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-088e7c7f-050a-48ae-8d59-c3fa1756a17b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:51.893934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-088e7c7f-050a-48ae-8d59-c3fa1756a17b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:51.894390 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-088e7c7f-050a-48ae-8d59-c3fa1756a17b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:51.895224 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-088e7c7f-050a-48ae-8d59-c3fa1756a17b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:51.895705 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-088e7c7f-050a-48ae-8d59-c3fa1756a17b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:51.902105 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54ffa406-2522-4fb8-8c57-754a121cd47d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:51.903271 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-54ffa406-2522-4fb8-8c57-754a121cd47d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:51.914415 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54ffa406-2522-4fb8-8c57-754a121cd47d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:51.915762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54ffa406-2522-4fb8-8c57-754a121cd47d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:51.918319 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54ffa406-2522-4fb8-8c57-754a121cd47d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:51.918319 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54ffa406-2522-4fb8-8c57-754a121cd47d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:52.082097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-54ffa406-2522-4fb8-8c57-754a121cd47d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:52.090360 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-54ffa406-2522-4fb8-8c57-754a121cd47d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.195523 Jul 14 11:08:52.090949 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 142/278] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:51 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:52.095853 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a77c082b-1a9c-46a1-bc84-bd98a49785f2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:52.096481 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a77c082b-1a9c-46a1-bc84-bd98a49785f2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:52.096770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-088e7c7f-050a-48ae-8d59-c3fa1756a17b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:52.103594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a77c082b-1a9c-46a1-bc84-bd98a49785f2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:52.104051 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a77c082b-1a9c-46a1-bc84-bd98a49785f2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:52.104833 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a77c082b-1a9c-46a1-bc84-bd98a49785f2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:52.105278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a77c082b-1a9c-46a1-bc84-bd98a49785f2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:52.110713 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-088e7c7f-050a-48ae-8d59-c3fa1756a17b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.228062 Jul 14 11:08:52.112444 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 137/279] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:51 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:52.252426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a77c082b-1a9c-46a1-bc84-bd98a49785f2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:52.260951 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a77c082b-1a9c-46a1-bc84-bd98a49785f2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.168920 Jul 14 11:08:52.261540 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 143/280] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:52 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:52.525559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:52.526165 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:52.532317 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:52.532799 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:52.533569 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:52.533998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:52.663870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:52.672747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:52.674265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:52.675441 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c6b450e5-9032-43b4-9648-c12b42e29ecb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.154279 Jul 14 11:08:52.676013 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 138/281] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:52 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:53.108224 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b60b4876-2aae-4d05-86a1-aaab924c8854 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:53.108832 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b60b4876-2aae-4d05-86a1-aaab924c8854 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:53.115167 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b60b4876-2aae-4d05-86a1-aaab924c8854 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:53.115690 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b60b4876-2aae-4d05-86a1-aaab924c8854 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:53.116490 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b60b4876-2aae-4d05-86a1-aaab924c8854 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:53.116924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b60b4876-2aae-4d05-86a1-aaab924c8854 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:53.137852 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e69f5e12-0ab0-4773-86cc-54ce28c730b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:53.139076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e69f5e12-0ab0-4773-86cc-54ce28c730b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:53.147339 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e69f5e12-0ab0-4773-86cc-54ce28c730b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:53.148148 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e69f5e12-0ab0-4773-86cc-54ce28c730b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:53.149008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e69f5e12-0ab0-4773-86cc-54ce28c730b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:53.150072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e69f5e12-0ab0-4773-86cc-54ce28c730b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:53.270871 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b60b4876-2aae-4d05-86a1-aaab924c8854 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:53.278634 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b60b4876-2aae-4d05-86a1-aaab924c8854 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.174142 Jul 14 11:08:53.279571 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 144/282] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:53 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:53.284969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0d92d482-b3f1-4ccb-898e-d9fb00a68cc4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:53.285939 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0d92d482-b3f1-4ccb-898e-d9fb00a68cc4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:53.292922 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d92d482-b3f1-4ccb-898e-d9fb00a68cc4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:53.292922 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d92d482-b3f1-4ccb-898e-d9fb00a68cc4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:53.293687 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d92d482-b3f1-4ccb-898e-d9fb00a68cc4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:53.294126 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d92d482-b3f1-4ccb-898e-d9fb00a68cc4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:53.313185 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e69f5e12-0ab0-4773-86cc-54ce28c730b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:53.322046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e69f5e12-0ab0-4773-86cc-54ce28c730b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.189038 Jul 14 11:08:53.331505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 139/283] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:53 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:53.475681 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0d92d482-b3f1-4ccb-898e-d9fb00a68cc4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:53.484348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0d92d482-b3f1-4ccb-898e-d9fb00a68cc4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.203241 Jul 14 11:08:53.484940 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 145/284] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:53 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:53.694518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:53.695116 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:53.701221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:53.701644 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:53.702408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:53.703341 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:53.839414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:53.847748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:53.849243 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:53.850328 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e7d0ac77-fb11-4029-946c-7e34b2459996 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.160136 Jul 14 11:08:53.850887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 140/285] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:53 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:54.296646 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a926c290-5097-4676-b5f1-8a0110772777 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:54.297247 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a926c290-5097-4676-b5f1-8a0110772777 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:54.303255 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a926c290-5097-4676-b5f1-8a0110772777 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:54.303744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a926c290-5097-4676-b5f1-8a0110772777 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:54.304783 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a926c290-5097-4676-b5f1-8a0110772777 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:54.305221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a926c290-5097-4676-b5f1-8a0110772777 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:54.338113 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ff97c7d9-b64f-4c25-b259-b7eba01c3415 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:54.338717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ff97c7d9-b64f-4c25-b259-b7eba01c3415 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:54.345121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff97c7d9-b64f-4c25-b259-b7eba01c3415 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:54.345573 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff97c7d9-b64f-4c25-b259-b7eba01c3415 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:54.346346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff97c7d9-b64f-4c25-b259-b7eba01c3415 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:54.346781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff97c7d9-b64f-4c25-b259-b7eba01c3415 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:54.440329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a926c290-5097-4676-b5f1-8a0110772777 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:54.448030 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a926c290-5097-4676-b5f1-8a0110772777 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.155204 Jul 14 11:08:54.448612 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 146/286] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:54 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:54.490380 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ff97c7d9-b64f-4c25-b259-b7eba01c3415 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:54.500302 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ff97c7d9-b64f-4c25-b259-b7eba01c3415 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.165930 Jul 14 11:08:54.500991 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 141/287] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:54 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:54.502305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0d7ab0df-4741-40af-91a1-c3082214e6ae tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:54.502913 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0d7ab0df-4741-40af-91a1-c3082214e6ae tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:54.510695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d7ab0df-4741-40af-91a1-c3082214e6ae tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:54.511270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d7ab0df-4741-40af-91a1-c3082214e6ae tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:54.512114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d7ab0df-4741-40af-91a1-c3082214e6ae tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:54.512557 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d7ab0df-4741-40af-91a1-c3082214e6ae tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:54.656489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0d7ab0df-4741-40af-91a1-c3082214e6ae tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:54.664192 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0d7ab0df-4741-40af-91a1-c3082214e6ae tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.166276 Jul 14 11:08:54.664781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 147/288] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:54 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:54.869780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:54.870284 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:54.876406 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:54.876846 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:54.877605 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:54.878038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:55.009687 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:55.017814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:55.019322 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:55.020462 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3df733e0-586f-4f6b-8d22-dd39b6d9a395 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.155270 Jul 14 11:08:55.020999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 142/289] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:54 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:55.465346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b78b10fb-276a-44bb-a2b1-ff3a8f946078 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:55.465945 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b78b10fb-276a-44bb-a2b1-ff3a8f946078 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:55.471920 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b78b10fb-276a-44bb-a2b1-ff3a8f946078 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:55.472379 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b78b10fb-276a-44bb-a2b1-ff3a8f946078 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:55.473117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b78b10fb-276a-44bb-a2b1-ff3a8f946078 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:55.473542 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b78b10fb-276a-44bb-a2b1-ff3a8f946078 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:55.518453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-989407dc-e489-4cfd-b013-360c16f8303d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:55.519457 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-989407dc-e489-4cfd-b013-360c16f8303d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:55.527264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-989407dc-e489-4cfd-b013-360c16f8303d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:55.527747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-989407dc-e489-4cfd-b013-360c16f8303d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:55.528530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-989407dc-e489-4cfd-b013-360c16f8303d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:55.528968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-989407dc-e489-4cfd-b013-360c16f8303d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:55.614551 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b78b10fb-276a-44bb-a2b1-ff3a8f946078 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:55.623046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b78b10fb-276a-44bb-a2b1-ff3a8f946078 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.162259 Jul 14 11:08:55.623652 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 148/290] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:55 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:55.668506 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-989407dc-e489-4cfd-b013-360c16f8303d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:55.676811 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-989407dc-e489-4cfd-b013-360c16f8303d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.162472 Jul 14 11:08:55.677560 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 143/291] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:55 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:55.682113 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-57016627-50db-4e13-9afc-72958db76c88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:55.682729 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-57016627-50db-4e13-9afc-72958db76c88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:55.689094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57016627-50db-4e13-9afc-72958db76c88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:55.689671 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57016627-50db-4e13-9afc-72958db76c88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:55.690565 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57016627-50db-4e13-9afc-72958db76c88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:55.690992 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57016627-50db-4e13-9afc-72958db76c88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:55.818105 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57016627-50db-4e13-9afc-72958db76c88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:55.825992 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-57016627-50db-4e13-9afc-72958db76c88 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.148154 Jul 14 11:08:55.826551 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 149/292] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:55 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:56.037552 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:56.038112 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:56.044182 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.044626 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.045388 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.045815 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.175978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:56.184912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:56.186442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:56.187593 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ef46dba3-c945-45cc-8dbc-38c7a47cde19 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.154054 Jul 14 11:08:56.188147 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 144/293] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:56 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:56.639948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1f59ab31-138c-4312-a26b-d851454089b7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:56.640808 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1f59ab31-138c-4312-a26b-d851454089b7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:56.652913 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f59ab31-138c-4312-a26b-d851454089b7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.652913 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f59ab31-138c-4312-a26b-d851454089b7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.652913 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f59ab31-138c-4312-a26b-d851454089b7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.652913 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f59ab31-138c-4312-a26b-d851454089b7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.653667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:56.695238 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-401b04bf-6713-43fa-b6d8-befb4be06df9 req-8670e66b-482a-40ee-8293-42154be92112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd47a70-769e-4bfc-8954-376cd1d1dd8f", "name": "network-vif-plugged", "status": "completed", "tag": "f17cb494-ce01-4f03-b511-25356a886eab"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:56.704922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-401b04bf-6713-43fa-b6d8-befb4be06df9 req-8670e66b-482a-40ee-8293-42154be92112 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.705511 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-401b04bf-6713-43fa-b6d8-befb4be06df9 req-8670e66b-482a-40ee-8293-42154be92112 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.720074 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-401b04bf-6713-43fa-b6d8-befb4be06df9 req-8670e66b-482a-40ee-8293-42154be92112 service nova] Creating event network-vif-plugged:f17cb494-ce01-4f03-b511-25356a886eab for instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f on hv-cinder-84893 Jul 14 11:08:56.726190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-401b04bf-6713-43fa-b6d8-befb4be06df9 req-8670e66b-482a-40ee-8293-42154be92112 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035323 Jul 14 11:08:56.727155 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 145/294] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:08:56.735592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-93f517af-c321-44af-885f-a6415f319ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:56.736415 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-93f517af-c321-44af-885f-a6415f319ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:56.747873 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-93f517af-c321-44af-885f-a6415f319ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.748344 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-93f517af-c321-44af-885f-a6415f319ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.749157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-93f517af-c321-44af-885f-a6415f319ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.749597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-93f517af-c321-44af-885f-a6415f319ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.802675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1f59ab31-138c-4312-a26b-d851454089b7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:56.816954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1f59ab31-138c-4312-a26b-d851454089b7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.180447 Jul 14 11:08:56.818058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 150/295] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:56 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:56.843111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33580ea6-36c4-4910-a4fa-ee507fbcfe4d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:56.843824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-33580ea6-36c4-4910-a4fa-ee507fbcfe4d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:56.849961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33580ea6-36c4-4910-a4fa-ee507fbcfe4d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.850408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33580ea6-36c4-4910-a4fa-ee507fbcfe4d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.851210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33580ea6-36c4-4910-a4fa-ee507fbcfe4d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:56.851668 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33580ea6-36c4-4910-a4fa-ee507fbcfe4d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:56.894612 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-93f517af-c321-44af-885f-a6415f319ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:56.902788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-93f517af-c321-44af-885f-a6415f319ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.174375 Jul 14 11:08:56.903372 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 146/296] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:56 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:56.984109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33580ea6-36c4-4910-a4fa-ee507fbcfe4d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:56.991491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33580ea6-36c4-4910-a4fa-ee507fbcfe4d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.152665 Jul 14 11:08:56.992078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 151/297] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:56 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:57.206076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:57.206672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:57.213413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:57.213851 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:57.214612 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:57.215042 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:57.506225 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:57.515189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:57.516741 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:57.517887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1b5b1ef0-1e6f-43d0-b581-0163a99030b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.315773 Jul 14 11:08:57.518457 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 147/298] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:57 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:57.841946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-373d742c-462e-4063-a26c-6f2a75946f09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:57.842545 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-373d742c-462e-4063-a26c-6f2a75946f09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:57.848929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-373d742c-462e-4063-a26c-6f2a75946f09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:57.849374 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-373d742c-462e-4063-a26c-6f2a75946f09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:57.850154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-373d742c-462e-4063-a26c-6f2a75946f09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:57.850586 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-373d742c-462e-4063-a26c-6f2a75946f09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:57.921924 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7635d308-3e15-49b9-89fc-3ea205f591bc tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:57.922488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7635d308-3e15-49b9-89fc-3ea205f591bc tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:57.928560 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7635d308-3e15-49b9-89fc-3ea205f591bc tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:57.929082 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7635d308-3e15-49b9-89fc-3ea205f591bc tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:57.930175 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7635d308-3e15-49b9-89fc-3ea205f591bc tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:57.932755 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7635d308-3e15-49b9-89fc-3ea205f591bc tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:57.995566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-373d742c-462e-4063-a26c-6f2a75946f09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:58.004471 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-373d742c-462e-4063-a26c-6f2a75946f09 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.166332 Jul 14 11:08:58.005043 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 152/299] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:57 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:58.011689 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-703c3424-6871-457e-9a9e-987da3d00363 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:58.012236 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-703c3424-6871-457e-9a9e-987da3d00363 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:58.018605 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-703c3424-6871-457e-9a9e-987da3d00363 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:58.019053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-703c3424-6871-457e-9a9e-987da3d00363 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:58.019843 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-703c3424-6871-457e-9a9e-987da3d00363 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:58.020277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-703c3424-6871-457e-9a9e-987da3d00363 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:58.068130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7635d308-3e15-49b9-89fc-3ea205f591bc tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:58.076221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7635d308-3e15-49b9-89fc-3ea205f591bc tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.158151 Jul 14 11:08:58.076819 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 148/300] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:57 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:58.155592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-703c3424-6871-457e-9a9e-987da3d00363 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:58.163200 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-703c3424-6871-457e-9a9e-987da3d00363 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.155435 Jul 14 11:08:58.163796 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 153/301] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:58 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:58.537051 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:58.537663 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:58.546499 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:58.547026 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:58.547746 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:58.548193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:58.567863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:58.710576 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:58.719252 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:58.720849 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:58.721916 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2432865c-dfd5-4a4a-8940-bfe0a29ab908 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1406 microversion: 2.20 time: 0.189379 Jul 14 11:08:58.722810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 149/302] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:58 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:08:58.811304 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-961041216", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:08:58.881754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] validate_networks() for None {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:08:59.021445 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6ed8feb5-213e-4bfb-abfb-3159d1a3ab72 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:59.022656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6ed8feb5-213e-4bfb-abfb-3159d1a3ab72 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:59.030064 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ed8feb5-213e-4bfb-abfb-3159d1a3ab72 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.030704 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ed8feb5-213e-4bfb-abfb-3159d1a3ab72 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.031677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ed8feb5-213e-4bfb-abfb-3159d1a3ab72 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.032277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ed8feb5-213e-4bfb-abfb-3159d1a3ab72 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.179635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6ed8feb5-213e-4bfb-abfb-3159d1a3ab72 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:59.187406 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6ed8feb5-213e-4bfb-abfb-3159d1a3ab72 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.169799 Jul 14 11:08:59.188058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 150/303] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:59 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:08:59.195332 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-af5d099b-a2d8-432e-ae71-861b202a151c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:59.196301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-af5d099b-a2d8-432e-ae71-861b202a151c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:59.202852 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:08:59.203352 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:08:59.203997 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:08:59.204408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:08:59.204865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:08:59.208810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-af5d099b-a2d8-432e-ae71-861b202a151c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.209469 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-af5d099b-a2d8-432e-ae71-861b202a151c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.211110 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-af5d099b-a2d8-432e-ae71-861b202a151c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.211586 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-af5d099b-a2d8-432e-ae71-861b202a151c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.215787 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.216177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.216974 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.217407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.235641 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Getting quotas for project 6d40780d34214bc6974bcb658be6b3d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:08:59.239988 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Getting quotas for user 99127dff61834187834bff45137b5747 and project 6d40780d34214bc6974bcb658be6b3d2. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:08:59.252445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:08:59.254858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:08:59.311461 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6152aa5f-31c2-4fee-a289-0d3a9b798b2e tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503564 Jul 14 11:08:59.312397 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 154/304] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:08:59.322762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8acc2dc5-9c0f-4389-b14b-a7532dc76443 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:59.323365 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8acc2dc5-9c0f-4389-b14b-a7532dc76443 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:59.329905 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8acc2dc5-9c0f-4389-b14b-a7532dc76443 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.331758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8acc2dc5-9c0f-4389-b14b-a7532dc76443 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.333323 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8acc2dc5-9c0f-4389-b14b-a7532dc76443 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.333820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8acc2dc5-9c0f-4389-b14b-a7532dc76443 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.428606 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-af5d099b-a2d8-432e-ae71-861b202a151c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:59.444171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-af5d099b-a2d8-432e-ae71-861b202a151c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1366 microversion: 2.1 time: 0.254204 Jul 14 11:08:59.456130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 151/305] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:59 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:59.467247 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e075f958-ed1f-41c1-bd6e-8b861051c4bb tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:59.469796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e075f958-ed1f-41c1-bd6e-8b861051c4bb tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:59.496794 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8acc2dc5-9c0f-4389-b14b-a7532dc76443 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:59.505861 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8acc2dc5-9c0f-4389-b14b-a7532dc76443 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1315 microversion: 2.1 time: 0.187364 Jul 14 11:08:59.506802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 155/306] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:59 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:59.561394 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e075f958-ed1f-41c1-bd6e-8b861051c4bb tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:08:59.574968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e075f958-ed1f-41c1-bd6e-8b861051c4bb tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1214 microversion: 2.1 time: 0.116069 Jul 14 11:08:59.575739 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 152/307] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:08:59 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:08:59.742797 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:08:59.743865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:08:59.750977 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.751968 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:08:59.753001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:08:59.753549 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.025065 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:00.035540 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:00.038960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:00.040571 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ae2e343b-b86e-40e1-aff4-5c5e57807b92 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1599 microversion: 2.20 time: 0.302263 Jul 14 11:09:00.041140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 156/308] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:08:59 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1599 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:09:00.060785 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e769c405-c396-4616-9cb5-675ea810c83b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:00.064507 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e769c405-c396-4616-9cb5-675ea810c83b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:00.074835 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e769c405-c396-4616-9cb5-675ea810c83b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.075295 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e769c405-c396-4616-9cb5-675ea810c83b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.076589 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e769c405-c396-4616-9cb5-675ea810c83b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.077037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e769c405-c396-4616-9cb5-675ea810c83b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.205854 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7eb36b46-dbbe-4669-9b24-f99234bb25a9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:00.206730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7eb36b46-dbbe-4669-9b24-f99234bb25a9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:00.214063 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7eb36b46-dbbe-4669-9b24-f99234bb25a9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.214815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7eb36b46-dbbe-4669-9b24-f99234bb25a9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.215846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7eb36b46-dbbe-4669-9b24-f99234bb25a9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.216450 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7eb36b46-dbbe-4669-9b24-f99234bb25a9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.260517 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e769c405-c396-4616-9cb5-675ea810c83b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.204931 Jul 14 11:09:00.261263 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 153/309] 10.222.0.75 () {60 vars in 1315 bytes} [Thu Jul 14 11:09:00 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:00.474140 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d90f4d0b-cecb-4a60-8cc0-53af55a7cd27 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:00.475588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d90f4d0b-cecb-4a60-8cc0-53af55a7cd27 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:00.481642 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d90f4d0b-cecb-4a60-8cc0-53af55a7cd27 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.482069 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d90f4d0b-cecb-4a60-8cc0-53af55a7cd27 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.483098 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d90f4d0b-cecb-4a60-8cc0-53af55a7cd27 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.483821 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d90f4d0b-cecb-4a60-8cc0-53af55a7cd27 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.646126 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7eb36b46-dbbe-4669-9b24-f99234bb25a9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:00.655614 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7eb36b46-dbbe-4669-9b24-f99234bb25a9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.453674 Jul 14 11:09:00.656535 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 157/310] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:00 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:00.661973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b9e61c97-8a16-4a50-a041-a8bc558c523a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:00.662859 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b9e61c97-8a16-4a50-a041-a8bc558c523a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:00.678738 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9e61c97-8a16-4a50-a041-a8bc558c523a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.680306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9e61c97-8a16-4a50-a041-a8bc558c523a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.682043 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9e61c97-8a16-4a50-a041-a8bc558c523a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.682694 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9e61c97-8a16-4a50-a041-a8bc558c523a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.702392 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d90f4d0b-cecb-4a60-8cc0-53af55a7cd27 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:00.710574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d90f4d0b-cecb-4a60-8cc0-53af55a7cd27 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1556 microversion: 2.1 time: 0.240764 Jul 14 11:09:00.711170 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 154/311] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:00 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:00.716312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b1431022-1764-4618-858f-57f489cc2ca0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:00.716926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b1431022-1764-4618-858f-57f489cc2ca0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:00.724318 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b1431022-1764-4618-858f-57f489cc2ca0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.724970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b1431022-1764-4618-858f-57f489cc2ca0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.725875 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b1431022-1764-4618-858f-57f489cc2ca0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.726506 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b1431022-1764-4618-858f-57f489cc2ca0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.796648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b1431022-1764-4618-858f-57f489cc2ca0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:00.806203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b1431022-1764-4618-858f-57f489cc2ca0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1218 microversion: 2.1 time: 0.093271 Jul 14 11:09:00.807200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 155/312] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:00 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:00.812439 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c01dbdb9-0849-445e-bcfb-6f9de0175876 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:00.813265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c01dbdb9-0849-445e-bcfb-6f9de0175876 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:00.819909 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c01dbdb9-0849-445e-bcfb-6f9de0175876 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.820619 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c01dbdb9-0849-445e-bcfb-6f9de0175876 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.821422 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c01dbdb9-0849-445e-bcfb-6f9de0175876 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:00.821862 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c01dbdb9-0849-445e-bcfb-6f9de0175876 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:00.916327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c01dbdb9-0849-445e-bcfb-6f9de0175876 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106321 Jul 14 11:09:00.917396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 156/313] 10.222.0.75 () {58 vars in 1274 bytes} [Thu Jul 14 11:09:00 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:01.212326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b9e61c97-8a16-4a50-a041-a8bc558c523a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:01.225542 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b9e61c97-8a16-4a50-a041-a8bc558c523a tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1502 microversion: 2.1 time: 0.567748 Jul 14 11:09:01.226770 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 158/314] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:00 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:01.682644 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-86cc4caf-555f-462a-a71b-0920653a5e20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:01.683345 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-86cc4caf-555f-462a-a71b-0920653a5e20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:01.695045 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86cc4caf-555f-462a-a71b-0920653a5e20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:01.699999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86cc4caf-555f-462a-a71b-0920653a5e20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:01.709171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86cc4caf-555f-462a-a71b-0920653a5e20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:01.711219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86cc4caf-555f-462a-a71b-0920653a5e20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:01.827268 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6ce200a-b3ca-4c52-a5a5-bcaed9c59155 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:01.828004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6ce200a-b3ca-4c52-a5a5-bcaed9c59155 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:01.842755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6ce200a-b3ca-4c52-a5a5-bcaed9c59155 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:01.843229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6ce200a-b3ca-4c52-a5a5-bcaed9c59155 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:01.845551 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6ce200a-b3ca-4c52-a5a5-bcaed9c59155 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:01.849491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6ce200a-b3ca-4c52-a5a5-bcaed9c59155 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:01.993696 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6ce200a-b3ca-4c52-a5a5-bcaed9c59155 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:02.007899 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6ce200a-b3ca-4c52-a5a5-bcaed9c59155 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1218 microversion: 2.1 time: 0.183997 Jul 14 11:09:02.008731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 159/315] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:01 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:02.194425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-86cc4caf-555f-462a-a71b-0920653a5e20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:02.225958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-86cc4caf-555f-462a-a71b-0920653a5e20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.548243 Jul 14 11:09:02.228617 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 157/316] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:01 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:02.651369 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d77b2015-a42b-43a4-ba6c-b604dfdc4b14 req-43e2bb26-a8a5-43bb-81c1-1a9f07dbe8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d03bde1-0583-4099-8098-0077a2fc1084", "tag": "81b715b1-2ff3-4295-9104-d4e547039e70"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:02.673652 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d77b2015-a42b-43a4-ba6c-b604dfdc4b14 req-43e2bb26-a8a5-43bb-81c1-1a9f07dbe8c5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:02.679032 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d77b2015-a42b-43a4-ba6c-b604dfdc4b14 req-43e2bb26-a8a5-43bb-81c1-1a9f07dbe8c5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:02.703430 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d77b2015-a42b-43a4-ba6c-b604dfdc4b14 req-43e2bb26-a8a5-43bb-81c1-1a9f07dbe8c5 service nova] Creating event network-changed:81b715b1-2ff3-4295-9104-d4e547039e70 for instance 4d03bde1-0583-4099-8098-0077a2fc1084 on hv-cinder-84893 Jul 14 11:09:02.719863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d77b2015-a42b-43a4-ba6c-b604dfdc4b14 req-43e2bb26-a8a5-43bb-81c1-1a9f07dbe8c5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072536 Jul 14 11:09:02.723594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 160/317] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:02.976416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3f157c0d-02ab-4446-8497-1fb9057d9c2d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faafaa80-5a0a-4350-b9c0-7ba135388a14"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:02.977744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3f157c0d-02ab-4446-8497-1fb9057d9c2d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:02.992856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f157c0d-02ab-4446-8497-1fb9057d9c2d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:02.993616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f157c0d-02ab-4446-8497-1fb9057d9c2d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:02.996286 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f157c0d-02ab-4446-8497-1fb9057d9c2d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:02.996983 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f157c0d-02ab-4446-8497-1fb9057d9c2d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:03.027653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5ba0d39f-bc32-45e1-bd25-f6aaac53097c tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:03.028728 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5ba0d39f-bc32-45e1-bd25-f6aaac53097c tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:03.048182 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ba0d39f-bc32-45e1-bd25-f6aaac53097c tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:03.048635 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ba0d39f-bc32-45e1-bd25-f6aaac53097c tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:03.049451 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ba0d39f-bc32-45e1-bd25-f6aaac53097c tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:03.049933 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ba0d39f-bc32-45e1-bd25-f6aaac53097c tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:03.320296 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5ba0d39f-bc32-45e1-bd25-f6aaac53097c tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:03.331954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5ba0d39f-bc32-45e1-bd25-f6aaac53097c tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1218 microversion: 2.1 time: 0.310407 Jul 14 11:09:03.332540 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 161/318] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:03 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1218 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:03.337069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1ea7b2ba-0925-4447-a1d5-53a62c86becd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:03.337675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1ea7b2ba-0925-4447-a1d5-53a62c86becd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:03.394046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ea7b2ba-0925-4447-a1d5-53a62c86becd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:03.394605 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ea7b2ba-0925-4447-a1d5-53a62c86becd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:03.398792 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ea7b2ba-0925-4447-a1d5-53a62c86becd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:03.399816 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ea7b2ba-0925-4447-a1d5-53a62c86becd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:04.242122 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1ea7b2ba-0925-4447-a1d5-53a62c86becd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:04.252925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1ea7b2ba-0925-4447-a1d5-53a62c86becd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1321 microversion: 2.1 time: 0.919333 Jul 14 11:09:04.256822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 162/319] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:03 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1321 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:04.268813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-3e4f6180-d08e-4e20-9a45-586f2142a774 req-10a42296-1247-44f0-b5e8-0170e68bc920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9966b0a3-56f9-486d-99ba-0e616d15167a", "tag": "60ab608d-54a2-43be-9f6e-4c5078b5c6b4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:04.286530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-3e4f6180-d08e-4e20-9a45-586f2142a774 req-10a42296-1247-44f0-b5e8-0170e68bc920 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:04.288754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-3e4f6180-d08e-4e20-9a45-586f2142a774 req-10a42296-1247-44f0-b5e8-0170e68bc920 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:04.388020 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-3e4f6180-d08e-4e20-9a45-586f2142a774 req-10a42296-1247-44f0-b5e8-0170e68bc920 service nova] Creating event network-changed:60ab608d-54a2-43be-9f6e-4c5078b5c6b4 for instance 9966b0a3-56f9-486d-99ba-0e616d15167a on hv-cinder-84893 Jul 14 11:09:04.399985 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-3e4f6180-d08e-4e20-9a45-586f2142a774 req-10a42296-1247-44f0-b5e8-0170e68bc920 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141450 Jul 14 11:09:04.402163 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3f157c0d-02ab-4446-8497-1fb9057d9c2d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "POST /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.429511 Jul 14 11:09:04.403611 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 163/320] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:04.409104 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f3c989db-76bb-4882-89ef-2a55c01c42bc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:04.410115 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 158/321] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:09:02 2022] POST /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d/os-volume_attachments => generated 194 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:04.415816 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f3c989db-76bb-4882-89ef-2a55c01c42bc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:04.425553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3c989db-76bb-4882-89ef-2a55c01c42bc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:04.428625 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3c989db-76bb-4882-89ef-2a55c01c42bc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:04.429698 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3c989db-76bb-4882-89ef-2a55c01c42bc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:04.430189 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3c989db-76bb-4882-89ef-2a55c01c42bc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:04.590056 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f3c989db-76bb-4882-89ef-2a55c01c42bc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:04.599684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f3c989db-76bb-4882-89ef-2a55c01c42bc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1266 microversion: 2.1 time: 0.194522 Jul 14 11:09:04.600431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 164/322] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:04 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:05.283167 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-29395026-a021-4bed-ac01-6acac9a4a5a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:05.283892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-29395026-a021-4bed-ac01-6acac9a4a5a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:05.303094 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-29395026-a021-4bed-ac01-6acac9a4a5a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:05.303900 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-29395026-a021-4bed-ac01-6acac9a4a5a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:05.308094 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-29395026-a021-4bed-ac01-6acac9a4a5a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:05.308762 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-29395026-a021-4bed-ac01-6acac9a4a5a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:05.622779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-71622190-62a1-46e1-a109-6a31de8af86a tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:05.625816 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-71622190-62a1-46e1-a109-6a31de8af86a tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:05.650519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71622190-62a1-46e1-a109-6a31de8af86a tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:05.655008 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71622190-62a1-46e1-a109-6a31de8af86a tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:05.657818 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71622190-62a1-46e1-a109-6a31de8af86a tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:05.662574 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71622190-62a1-46e1-a109-6a31de8af86a tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:05.913060 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71622190-62a1-46e1-a109-6a31de8af86a tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:05.927426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-71622190-62a1-46e1-a109-6a31de8af86a tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1274 microversion: 2.1 time: 0.313474 Jul 14 11:09:05.932347 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 165/323] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:05 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1274 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:06.079960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-29395026-a021-4bed-ac01-6acac9a4a5a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:06.091737 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-29395026-a021-4bed-ac01-6acac9a4a5a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1514 microversion: 2.1 time: 0.812974 Jul 14 11:09:06.092835 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 159/324] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:05 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1514 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:06.115989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-29570a18-9d35-43e2-b521-e6d06932001a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:06.117218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-29570a18-9d35-43e2-b521-e6d06932001a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:06.126412 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29570a18-9d35-43e2-b521-e6d06932001a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:06.126863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29570a18-9d35-43e2-b521-e6d06932001a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:06.128002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29570a18-9d35-43e2-b521-e6d06932001a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:06.128290 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29570a18-9d35-43e2-b521-e6d06932001a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:06.228585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-29570a18-9d35-43e2-b521-e6d06932001a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lazy-loading 'flavor' on Instance uuid 7dd47a70-769e-4bfc-8954-376cd1d1dd8f {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:09:06.457573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:06.477075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-29570a18-9d35-43e2-b521-e6d06932001a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f/action" status: 200 len: 32 microversion: 2.1 time: 0.366148 Jul 14 11:09:06.478711 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 166/325] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:09:06 2022] POST /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:09:06.491448 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4f5a537c-9c89-4cc6-a3f1-b59fbfcad770 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:06.492583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4f5a537c-9c89-4cc6-a3f1-b59fbfcad770 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:06.512129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f5a537c-9c89-4cc6-a3f1-b59fbfcad770 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:06.512968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f5a537c-9c89-4cc6-a3f1-b59fbfcad770 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:06.515513 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f5a537c-9c89-4cc6-a3f1-b59fbfcad770 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:06.517038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f5a537c-9c89-4cc6-a3f1-b59fbfcad770 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:06.952447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-657f8466-2131-4c68-9c07-7974f3bfda48 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:06.953649 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-657f8466-2131-4c68-9c07-7974f3bfda48 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:06.966390 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-657f8466-2131-4c68-9c07-7974f3bfda48 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:06.966849 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-657f8466-2131-4c68-9c07-7974f3bfda48 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:06.967666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-657f8466-2131-4c68-9c07-7974f3bfda48 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:06.968105 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-657f8466-2131-4c68-9c07-7974f3bfda48 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:07.083588 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-657f8466-2131-4c68-9c07-7974f3bfda48 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:07.092855 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-657f8466-2131-4c68-9c07-7974f3bfda48 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1272 microversion: 2.1 time: 0.146074 Jul 14 11:09:07.093452 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 167/326] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:06 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:07.241335 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4f5a537c-9c89-4cc6-a3f1-b59fbfcad770 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:07.276616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4f5a537c-9c89-4cc6-a3f1-b59fbfcad770 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.792943 Jul 14 11:09:07.278423 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 160/327] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:06 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:08.116583 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7581548f-2ece-410a-9425-830b4498d387 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:08.117721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7581548f-2ece-410a-9425-830b4498d387 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:08.125815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7581548f-2ece-410a-9425-830b4498d387 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:08.126399 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7581548f-2ece-410a-9425-830b4498d387 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:08.127338 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7581548f-2ece-410a-9425-830b4498d387 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:08.127935 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7581548f-2ece-410a-9425-830b4498d387 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:08.300513 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3b0da871-08b3-4306-ae48-9b5e95b05a92 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:08.308495 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3b0da871-08b3-4306-ae48-9b5e95b05a92 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:08.320654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b0da871-08b3-4306-ae48-9b5e95b05a92 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:08.323409 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b0da871-08b3-4306-ae48-9b5e95b05a92 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:08.324840 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b0da871-08b3-4306-ae48-9b5e95b05a92 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:08.325915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b0da871-08b3-4306-ae48-9b5e95b05a92 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:08.352848 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7581548f-2ece-410a-9425-830b4498d387 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:08.364457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7581548f-2ece-410a-9425-830b4498d387 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1272 microversion: 2.1 time: 0.253666 Jul 14 11:09:08.365502 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 168/328] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:08 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:09.039552 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3b0da871-08b3-4306-ae48-9b5e95b05a92 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:09.051903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3b0da871-08b3-4306-ae48-9b5e95b05a92 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.759459 Jul 14 11:09:09.053232 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 161/329] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:08 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:09.384278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-251025e6-d0ed-49d2-bcee-a5f65486eacc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:09.385732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-251025e6-d0ed-49d2-bcee-a5f65486eacc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:09.388048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:09.388966 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:09.398368 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-251025e6-d0ed-49d2-bcee-a5f65486eacc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:09.401490 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-251025e6-d0ed-49d2-bcee-a5f65486eacc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:09.402628 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-251025e6-d0ed-49d2-bcee-a5f65486eacc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:09.403287 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-251025e6-d0ed-49d2-bcee-a5f65486eacc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:09.614298 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-251025e6-d0ed-49d2-bcee-a5f65486eacc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:09.625005 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-251025e6-d0ed-49d2-bcee-a5f65486eacc tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.246728 Jul 14 11:09:09.627243 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 169/330] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:09 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:10.083802 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e80a195c-74ce-4de4-be1d-b74e9e2368d6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:10.084415 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e80a195c-74ce-4de4-be1d-b74e9e2368d6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:10.094358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:10.109678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80a195c-74ce-4de4-be1d-b74e9e2368d6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:10.120796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80a195c-74ce-4de4-be1d-b74e9e2368d6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:10.122077 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80a195c-74ce-4de4-be1d-b74e9e2368d6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:10.122688 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80a195c-74ce-4de4-be1d-b74e9e2368d6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:10.213612 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-45f7f61c-1544-4de4-92d2-77aa11cfdf8a req-1598f0dd-8b0f-4d09-8b34-a28723a1a7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fbdd94c-50a9-4ee5-8660-d71902ee0cb4", "tag": "40a0af58-23a9-4e89-930f-b6de42139ec4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:10.222367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-45f7f61c-1544-4de4-92d2-77aa11cfdf8a req-1598f0dd-8b0f-4d09-8b34-a28723a1a7a2 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:10.222805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-45f7f61c-1544-4de4-92d2-77aa11cfdf8a req-1598f0dd-8b0f-4d09-8b34-a28723a1a7a2 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:10.257390 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-45f7f61c-1544-4de4-92d2-77aa11cfdf8a req-1598f0dd-8b0f-4d09-8b34-a28723a1a7a2 service nova] Creating event network-changed:40a0af58-23a9-4e89-930f-b6de42139ec4 for instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 on hv-cinder-84893 Jul 14 11:09:10.278877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-45f7f61c-1544-4de4-92d2-77aa11cfdf8a req-1598f0dd-8b0f-4d09-8b34-a28723a1a7a2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090695 Jul 14 11:09:10.280927 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 170/331] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:09:10.451200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e80a195c-74ce-4de4-be1d-b74e9e2368d6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:10.482734 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e80a195c-74ce-4de4-be1d-b74e9e2368d6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.399635 Jul 14 11:09:10.482734 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 162/332] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:10 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:10.644279 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-800f52f3-19b9-47b5-9873-cb7418f2f6a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:10.645021 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-800f52f3-19b9-47b5-9873-cb7418f2f6a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:10.656483 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-800f52f3-19b9-47b5-9873-cb7418f2f6a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:10.657312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-800f52f3-19b9-47b5-9873-cb7418f2f6a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:10.658181 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-800f52f3-19b9-47b5-9873-cb7418f2f6a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:10.658642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-800f52f3-19b9-47b5-9873-cb7418f2f6a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:10.800258 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-800f52f3-19b9-47b5-9873-cb7418f2f6a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:10.808494 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-800f52f3-19b9-47b5-9873-cb7418f2f6a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.168492 Jul 14 11:09:10.809069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 171/333] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:10 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:11.498298 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cc2687e4-4b8d-4edc-8079-9538f0706852 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:11.498928 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cc2687e4-4b8d-4edc-8079-9538f0706852 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:11.506677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc2687e4-4b8d-4edc-8079-9538f0706852 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:11.507130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc2687e4-4b8d-4edc-8079-9538f0706852 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:11.507984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc2687e4-4b8d-4edc-8079-9538f0706852 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:11.508501 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc2687e4-4b8d-4edc-8079-9538f0706852 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:11.698096 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cc2687e4-4b8d-4edc-8079-9538f0706852 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:11.712615 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cc2687e4-4b8d-4edc-8079-9538f0706852 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.214858 Jul 14 11:09:11.712615 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 163/334] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:11 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:11.830756 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dd5f3949-2ef2-4d1b-ae53-fee4eb8afd06 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:11.831786 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dd5f3949-2ef2-4d1b-ae53-fee4eb8afd06 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:11.843309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd5f3949-2ef2-4d1b-ae53-fee4eb8afd06 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:11.844331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd5f3949-2ef2-4d1b-ae53-fee4eb8afd06 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:11.845487 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd5f3949-2ef2-4d1b-ae53-fee4eb8afd06 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:11.845960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd5f3949-2ef2-4d1b-ae53-fee4eb8afd06 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:12.016934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dd5f3949-2ef2-4d1b-ae53-fee4eb8afd06 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:12.026126 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dd5f3949-2ef2-4d1b-ae53-fee4eb8afd06 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.203046 Jul 14 11:09:12.026963 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 172/335] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:11 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:12.728742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6de0db48-c612-401a-b0a3-79e3fb4f39f7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:12.729368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6de0db48-c612-401a-b0a3-79e3fb4f39f7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:12.736805 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6de0db48-c612-401a-b0a3-79e3fb4f39f7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:12.737473 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6de0db48-c612-401a-b0a3-79e3fb4f39f7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:12.738357 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6de0db48-c612-401a-b0a3-79e3fb4f39f7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:12.738789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6de0db48-c612-401a-b0a3-79e3fb4f39f7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:12.899002 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6de0db48-c612-401a-b0a3-79e3fb4f39f7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:12.906830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6de0db48-c612-401a-b0a3-79e3fb4f39f7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.182765 Jul 14 11:09:12.907978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 164/336] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:12 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:13.050362 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1bfc3fc8-8f0e-4279-aca6-025f57d734a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:13.050987 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1bfc3fc8-8f0e-4279-aca6-025f57d734a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:13.062089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bfc3fc8-8f0e-4279-aca6-025f57d734a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:13.062787 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bfc3fc8-8f0e-4279-aca6-025f57d734a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:13.063763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bfc3fc8-8f0e-4279-aca6-025f57d734a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:13.064644 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bfc3fc8-8f0e-4279-aca6-025f57d734a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:13.290254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1bfc3fc8-8f0e-4279-aca6-025f57d734a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:13.298178 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1bfc3fc8-8f0e-4279-aca6-025f57d734a9 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.258094 Jul 14 11:09:13.298759 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 173/337] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:13 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:13.927016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ed68180d-a6f4-4729-a611-bc2a3b8412fe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:13.928928 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ed68180d-a6f4-4729-a611-bc2a3b8412fe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:13.938356 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed68180d-a6f4-4729-a611-bc2a3b8412fe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:13.938849 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed68180d-a6f4-4729-a611-bc2a3b8412fe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:13.939871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed68180d-a6f4-4729-a611-bc2a3b8412fe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:13.940651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed68180d-a6f4-4729-a611-bc2a3b8412fe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:14.133063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ed68180d-a6f4-4729-a611-bc2a3b8412fe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:14.146630 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ed68180d-a6f4-4729-a611-bc2a3b8412fe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.225477 Jul 14 11:09:14.147867 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 165/338] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:13 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:14.316216 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-35ff1f71-88c3-4c41-8b27-d19f55f27f9f tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:14.316977 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-35ff1f71-88c3-4c41-8b27-d19f55f27f9f tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:14.324301 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35ff1f71-88c3-4c41-8b27-d19f55f27f9f tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:14.325116 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35ff1f71-88c3-4c41-8b27-d19f55f27f9f tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:14.326105 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35ff1f71-88c3-4c41-8b27-d19f55f27f9f tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:14.326547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35ff1f71-88c3-4c41-8b27-d19f55f27f9f tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:14.497270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-35ff1f71-88c3-4c41-8b27-d19f55f27f9f tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:14.506553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-35ff1f71-88c3-4c41-8b27-d19f55f27f9f tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.194139 Jul 14 11:09:14.516260 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 174/339] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:14 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:15.166424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-001a8fc9-f356-465a-8b16-e3b5cfdf7b64 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:15.167738 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-001a8fc9-f356-465a-8b16-e3b5cfdf7b64 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:15.176297 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-001a8fc9-f356-465a-8b16-e3b5cfdf7b64 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:15.177543 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-001a8fc9-f356-465a-8b16-e3b5cfdf7b64 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:15.178496 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-001a8fc9-f356-465a-8b16-e3b5cfdf7b64 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:15.178939 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-001a8fc9-f356-465a-8b16-e3b5cfdf7b64 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:15.202516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:15.377906 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-001a8fc9-f356-465a-8b16-e3b5cfdf7b64 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:15.392692 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-001a8fc9-f356-465a-8b16-e3b5cfdf7b64 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.228958 Jul 14 11:09:15.394129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 166/340] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:15 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:15.524433 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8161407c-6551-4d3e-9642-735297e55c75 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:15.526964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8161407c-6551-4d3e-9642-735297e55c75 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:15.540638 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8161407c-6551-4d3e-9642-735297e55c75 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:15.541094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8161407c-6551-4d3e-9642-735297e55c75 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:15.541881 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8161407c-6551-4d3e-9642-735297e55c75 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:15.542314 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8161407c-6551-4d3e-9642-735297e55c75 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:15.745586 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8161407c-6551-4d3e-9642-735297e55c75 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:15.763617 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8161407c-6551-4d3e-9642-735297e55c75 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.243619 Jul 14 11:09:15.783572 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 175/341] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:15 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:16.413937 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8cbfa9d6-8f13-49e6-9b57-6cf3c5d13455 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:16.415136 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8cbfa9d6-8f13-49e6-9b57-6cf3c5d13455 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:16.430940 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8cbfa9d6-8f13-49e6-9b57-6cf3c5d13455 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:16.434231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8cbfa9d6-8f13-49e6-9b57-6cf3c5d13455 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:16.435530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8cbfa9d6-8f13-49e6-9b57-6cf3c5d13455 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:16.436132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8cbfa9d6-8f13-49e6-9b57-6cf3c5d13455 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:16.672801 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8cbfa9d6-8f13-49e6-9b57-6cf3c5d13455 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:16.681304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8cbfa9d6-8f13-49e6-9b57-6cf3c5d13455 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.273406 Jul 14 11:09:16.682491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 167/342] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:16 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:16.727786 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b2dbd591-b94c-46c4-97ff-749b3c3e3c6d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:16.728873 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2dbd591-b94c-46c4-97ff-749b3c3e3c6d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:16.735785 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2dbd591-b94c-46c4-97ff-749b3c3e3c6d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:16.736230 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2dbd591-b94c-46c4-97ff-749b3c3e3c6d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:16.736997 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2dbd591-b94c-46c4-97ff-749b3c3e3c6d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:16.737422 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2dbd591-b94c-46c4-97ff-749b3c3e3c6d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:16.763461 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2dbd591-b94c-46c4-97ff-749b3c3e3c6d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:09:16.781001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6815e373-07dd-47a4-baf7-5a8fec473d14 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:16.781718 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6815e373-07dd-47a4-baf7-5a8fec473d14 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:16.787373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=80 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:16.790152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6815e373-07dd-47a4-baf7-5a8fec473d14 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:16.790728 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6815e373-07dd-47a4-baf7-5a8fec473d14 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:16.791659 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6815e373-07dd-47a4-baf7-5a8fec473d14 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:16.792223 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6815e373-07dd-47a4-baf7-5a8fec473d14 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:16.876881 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b2dbd591-b94c-46c4-97ff-749b3c3e3c6d tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 204 len: 0 microversion: 2.1 time: 0.153033 Jul 14 11:09:16.877476 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 176/343] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:09:16 2022] DELETE /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:09:16.891578 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-18e6068b-cc9f-4e7c-a703-c05bc5cf050e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:16.894624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-18e6068b-cc9f-4e7c-a703-c05bc5cf050e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:16.901355 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e6068b-cc9f-4e7c-a703-c05bc5cf050e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:16.902706 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e6068b-cc9f-4e7c-a703-c05bc5cf050e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:16.904388 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e6068b-cc9f-4e7c-a703-c05bc5cf050e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:16.905039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e6068b-cc9f-4e7c-a703-c05bc5cf050e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:17.130499 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6815e373-07dd-47a4-baf7-5a8fec473d14 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:17.141306 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6815e373-07dd-47a4-baf7-5a8fec473d14 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.364824 Jul 14 11:09:17.152692 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 168/344] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:16 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:17.160431 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-1086bd26-f351-4ea4-b1ff-597a6f601625 req-9daa29a0-a224-4b59-bac9-4b963b581b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbdd94c-50a9-4ee5-8660-d71902ee0cb4", "name": "network-vif-plugged", "status": "completed", "tag": "40a0af58-23a9-4e89-930f-b6de42139ec4"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:17.165983 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-18e6068b-cc9f-4e7c-a703-c05bc5cf050e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:17.174630 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-1086bd26-f351-4ea4-b1ff-597a6f601625 req-9daa29a0-a224-4b59-bac9-4b963b581b5f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:17.176198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-18e6068b-cc9f-4e7c-a703-c05bc5cf050e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1554 microversion: 2.1 time: 0.291265 Jul 14 11:09:17.176588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-1086bd26-f351-4ea4-b1ff-597a6f601625 req-9daa29a0-a224-4b59-bac9-4b963b581b5f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:17.177875 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 177/345] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:16 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1554 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:17.199551 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-1086bd26-f351-4ea4-b1ff-597a6f601625 req-9daa29a0-a224-4b59-bac9-4b963b581b5f service nova] Creating event network-vif-plugged:40a0af58-23a9-4e89-930f-b6de42139ec4 for instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 on hv-cinder-84893 Jul 14 11:09:17.206342 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-1086bd26-f351-4ea4-b1ff-597a6f601625 req-9daa29a0-a224-4b59-bac9-4b963b581b5f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051610 Jul 14 11:09:17.207675 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 169/346] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:17.698744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5f648ef8-de20-4ed4-817f-ab2385db3ec3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:17.699355 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5f648ef8-de20-4ed4-817f-ab2385db3ec3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:17.708934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5f648ef8-de20-4ed4-817f-ab2385db3ec3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:17.709296 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5f648ef8-de20-4ed4-817f-ab2385db3ec3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:17.710093 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5f648ef8-de20-4ed4-817f-ab2385db3ec3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:17.710526 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5f648ef8-de20-4ed4-817f-ab2385db3ec3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:17.856220 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5f648ef8-de20-4ed4-817f-ab2385db3ec3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:17.864276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5f648ef8-de20-4ed4-817f-ab2385db3ec3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.169629 Jul 14 11:09:17.864868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 178/347] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:17 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:18.160288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-065d1836-65f8-488b-86ab-3215b6ac4f7d tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:18.160984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-065d1836-65f8-488b-86ab-3215b6ac4f7d tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:18.167748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-065d1836-65f8-488b-86ab-3215b6ac4f7d tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:18.168614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-065d1836-65f8-488b-86ab-3215b6ac4f7d tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:18.169382 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-065d1836-65f8-488b-86ab-3215b6ac4f7d tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:18.169815 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-065d1836-65f8-488b-86ab-3215b6ac4f7d tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:18.193824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e8e18bed-827f-4a67-b89a-a7b03a9e8e00 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:18.195316 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e8e18bed-827f-4a67-b89a-a7b03a9e8e00 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:18.206931 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8e18bed-827f-4a67-b89a-a7b03a9e8e00 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:18.207420 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8e18bed-827f-4a67-b89a-a7b03a9e8e00 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:18.208201 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8e18bed-827f-4a67-b89a-a7b03a9e8e00 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:18.208798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8e18bed-827f-4a67-b89a-a7b03a9e8e00 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:18.351438 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-065d1836-65f8-488b-86ab-3215b6ac4f7d tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:18.359556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e8e18bed-827f-4a67-b89a-a7b03a9e8e00 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:18.366136 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-065d1836-65f8-488b-86ab-3215b6ac4f7d tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.210542 Jul 14 11:09:18.366734 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 170/348] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:18 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:18.369635 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e8e18bed-827f-4a67-b89a-a7b03a9e8e00 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1554 microversion: 2.1 time: 0.179600 Jul 14 11:09:18.370208 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 179/349] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:18 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:18.884126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-80b0e431-b5e5-4409-ac77-99e0771373e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:18.884725 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-80b0e431-b5e5-4409-ac77-99e0771373e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:18.891767 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-80b0e431-b5e5-4409-ac77-99e0771373e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:18.892219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-80b0e431-b5e5-4409-ac77-99e0771373e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:18.892993 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-80b0e431-b5e5-4409-ac77-99e0771373e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:18.893476 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-80b0e431-b5e5-4409-ac77-99e0771373e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:19.056534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-80b0e431-b5e5-4409-ac77-99e0771373e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:19.069391 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-80b0e431-b5e5-4409-ac77-99e0771373e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.189516 Jul 14 11:09:19.070149 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 171/350] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:18 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:19.383401 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4b7dc46-1e1c-4281-b4f9-5e6ad80aef24 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:19.383905 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a4b7dc46-1e1c-4281-b4f9-5e6ad80aef24 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:19.385254 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-075787ad-a1fe-46d5-a4eb-58aab3d6e7aa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:19.385863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-075787ad-a1fe-46d5-a4eb-58aab3d6e7aa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:19.389903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4b7dc46-1e1c-4281-b4f9-5e6ad80aef24 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:19.390338 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4b7dc46-1e1c-4281-b4f9-5e6ad80aef24 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:19.391094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4b7dc46-1e1c-4281-b4f9-5e6ad80aef24 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:19.391558 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4b7dc46-1e1c-4281-b4f9-5e6ad80aef24 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:19.392387 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-075787ad-a1fe-46d5-a4eb-58aab3d6e7aa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:19.392837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-075787ad-a1fe-46d5-a4eb-58aab3d6e7aa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:19.393599 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-075787ad-a1fe-46d5-a4eb-58aab3d6e7aa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:19.394034 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-075787ad-a1fe-46d5-a4eb-58aab3d6e7aa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:19.532710 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a4b7dc46-1e1c-4281-b4f9-5e6ad80aef24 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:19.540973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a4b7dc46-1e1c-4281-b4f9-5e6ad80aef24 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.161553 Jul 14 11:09:19.541558 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 180/351] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:19 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:19.559101 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-075787ad-a1fe-46d5-a4eb-58aab3d6e7aa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:19.567119 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-075787ad-a1fe-46d5-a4eb-58aab3d6e7aa tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1554 microversion: 2.1 time: 0.185628 Jul 14 11:09:19.567710 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 172/352] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:19 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:20.086830 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-50f1efa8-8288-43a4-9c21-7c2ba8ca6213 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:20.087468 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-50f1efa8-8288-43a4-9c21-7c2ba8ca6213 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:20.089557 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:20.095528 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50f1efa8-8288-43a4-9c21-7c2ba8ca6213 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:20.096001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50f1efa8-8288-43a4-9c21-7c2ba8ca6213 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:20.096820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50f1efa8-8288-43a4-9c21-7c2ba8ca6213 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:20.097254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50f1efa8-8288-43a4-9c21-7c2ba8ca6213 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:20.242427 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-50f1efa8-8288-43a4-9c21-7c2ba8ca6213 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:20.250961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-50f1efa8-8288-43a4-9c21-7c2ba8ca6213 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.168563 Jul 14 11:09:20.251764 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 181/353] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:20 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:20.558289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-21c6e66f-5f58-40c3-ad8e-861d79107a51 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:20.558892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-21c6e66f-5f58-40c3-ad8e-861d79107a51 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:20.565792 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21c6e66f-5f58-40c3-ad8e-861d79107a51 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:20.566421 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21c6e66f-5f58-40c3-ad8e-861d79107a51 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:20.567326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21c6e66f-5f58-40c3-ad8e-861d79107a51 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:20.567800 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21c6e66f-5f58-40c3-ad8e-861d79107a51 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:20.584769 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d7a426ce-8987-4d4d-9162-e7b25c408a06 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:20.585377 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d7a426ce-8987-4d4d-9162-e7b25c408a06 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:20.592008 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7a426ce-8987-4d4d-9162-e7b25c408a06 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:20.592467 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7a426ce-8987-4d4d-9162-e7b25c408a06 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:20.593231 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7a426ce-8987-4d4d-9162-e7b25c408a06 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:20.593665 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7a426ce-8987-4d4d-9162-e7b25c408a06 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:20.612557 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:20.741662 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d7a426ce-8987-4d4d-9162-e7b25c408a06 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:20.755960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d7a426ce-8987-4d4d-9162-e7b25c408a06 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1554 microversion: 2.1 time: 0.174580 Jul 14 11:09:20.757020 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 182/354] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:20 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:20.938038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-21c6e66f-5f58-40c3-ad8e-861d79107a51 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:20.949448 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-21c6e66f-5f58-40c3-ad8e-861d79107a51 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.395098 Jul 14 11:09:20.950065 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 173/355] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:20 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:21.270299 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c15d1085-471c-4534-b930-4b0f3a04632e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:21.270998 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c15d1085-471c-4534-b930-4b0f3a04632e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:21.278900 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c15d1085-471c-4534-b930-4b0f3a04632e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:21.279421 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c15d1085-471c-4534-b930-4b0f3a04632e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:21.280337 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c15d1085-471c-4534-b930-4b0f3a04632e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:21.280856 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c15d1085-471c-4534-b930-4b0f3a04632e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:21.421232 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c15d1085-471c-4534-b930-4b0f3a04632e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:21.428805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c15d1085-471c-4534-b930-4b0f3a04632e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.163480 Jul 14 11:09:21.430388 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 183/356] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:21 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:21.694474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-da0ede86-5d4e-4036-8d75-570789cad191 req-a3b87640-1fb8-4026-9e14-7ed0d9c799b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15adbd9-9e3f-4368-8dc4-45ecc5436d5d", "name": "network-vif-deleted", "tag": "24f57bda-0f9e-4061-8641-12b57f112b43"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:21.704935 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-da0ede86-5d4e-4036-8d75-570789cad191 req-a3b87640-1fb8-4026-9e14-7ed0d9c799b5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:21.705486 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-da0ede86-5d4e-4036-8d75-570789cad191 req-a3b87640-1fb8-4026-9e14-7ed0d9c799b5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:21.717994 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-da0ede86-5d4e-4036-8d75-570789cad191 req-a3b87640-1fb8-4026-9e14-7ed0d9c799b5 service nova] Creating event network-vif-deleted:24f57bda-0f9e-4061-8641-12b57f112b43 for instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d on hv-cinder-84893 Jul 14 11:09:21.723823 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-da0ede86-5d4e-4036-8d75-570789cad191 req-a3b87640-1fb8-4026-9e14-7ed0d9c799b5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 Jul 14 11:09:21.724737 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 174/357] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:21.782589 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88f81b9d-43ff-4983-9e95-f0962940d8e7 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:21.783309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88f81b9d-43ff-4983-9e95-f0962940d8e7 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:21.790251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88f81b9d-43ff-4983-9e95-f0962940d8e7 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:21.790692 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88f81b9d-43ff-4983-9e95-f0962940d8e7 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:21.791500 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88f81b9d-43ff-4983-9e95-f0962940d8e7 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:21.791932 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88f81b9d-43ff-4983-9e95-f0962940d8e7 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:21.855776 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88f81b9d-43ff-4983-9e95-f0962940d8e7 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:21.863924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88f81b9d-43ff-4983-9e95-f0962940d8e7 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1512 microversion: 2.1 time: 0.085457 Jul 14 11:09:21.864500 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 184/358] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:21 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1512 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:21.968454 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-79ecf919-9b7d-44d6-a6e7-f8eb81cee20b tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:21.969157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-79ecf919-9b7d-44d6-a6e7-f8eb81cee20b tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:21.976002 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79ecf919-9b7d-44d6-a6e7-f8eb81cee20b tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:21.976449 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79ecf919-9b7d-44d6-a6e7-f8eb81cee20b tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:21.977231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79ecf919-9b7d-44d6-a6e7-f8eb81cee20b tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:21.977665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79ecf919-9b7d-44d6-a6e7-f8eb81cee20b tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:22.124435 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-79ecf919-9b7d-44d6-a6e7-f8eb81cee20b tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:22.131997 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-79ecf919-9b7d-44d6-a6e7-f8eb81cee20b tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1314 microversion: 2.1 time: 0.167867 Jul 14 11:09:22.132563 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 175/359] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:21 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:22.454244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-df837e49-079b-43de-9657-6461062be7ca tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:22.456099 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-df837e49-079b-43de-9657-6461062be7ca tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:22.481045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df837e49-079b-43de-9657-6461062be7ca tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:22.482637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df837e49-079b-43de-9657-6461062be7ca tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:22.484958 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df837e49-079b-43de-9657-6461062be7ca tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:22.495897 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df837e49-079b-43de-9657-6461062be7ca tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:22.707953 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-df837e49-079b-43de-9657-6461062be7ca tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:22.716609 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-df837e49-079b-43de-9657-6461062be7ca tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.272859 Jul 14 11:09:22.717151 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 185/360] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:22 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:22.882671 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-25cc2b00-2e94-4b32-bf60-e493cf7c41a4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:22.883416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-25cc2b00-2e94-4b32-bf60-e493cf7c41a4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:22.892098 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25cc2b00-2e94-4b32-bf60-e493cf7c41a4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:22.892380 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25cc2b00-2e94-4b32-bf60-e493cf7c41a4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:22.893524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25cc2b00-2e94-4b32-bf60-e493cf7c41a4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:22.894121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25cc2b00-2e94-4b32-bf60-e493cf7c41a4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:22.996783 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-25cc2b00-2e94-4b32-bf60-e493cf7c41a4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f330cdfd7d2b47a985d8dc76c19da9a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90a870ee4154287be1282b3f46bdd05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:23.009666 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-25cc2b00-2e94-4b32-bf60-e493cf7c41a4 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 200 len: 1346 microversion: 2.1 time: 0.131604 Jul 14 11:09:23.010381 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 176/361] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:22 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 1346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:23.151652 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dbdf0cd8-9f3a-4a90-b0a4-60e9f9f6e459 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:23.152298 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dbdf0cd8-9f3a-4a90-b0a4-60e9f9f6e459 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:23.165998 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbdf0cd8-9f3a-4a90-b0a4-60e9f9f6e459 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:23.166698 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbdf0cd8-9f3a-4a90-b0a4-60e9f9f6e459 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:23.167550 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbdf0cd8-9f3a-4a90-b0a4-60e9f9f6e459 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:23.168210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbdf0cd8-9f3a-4a90-b0a4-60e9f9f6e459 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:23.340866 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dbdf0cd8-9f3a-4a90-b0a4-60e9f9f6e459 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:23.349184 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dbdf0cd8-9f3a-4a90-b0a4-60e9f9f6e459 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1464 microversion: 2.1 time: 0.203560 Jul 14 11:09:23.349777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 186/362] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:23 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1464 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:23.391973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-948486f0-ef6a-482e-a6ad-54e2978573a6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:23.392468 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-948486f0-ef6a-482e-a6ad-54e2978573a6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:23.400276 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-948486f0-ef6a-482e-a6ad-54e2978573a6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:23.400727 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-948486f0-ef6a-482e-a6ad-54e2978573a6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:23.401505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-948486f0-ef6a-482e-a6ad-54e2978573a6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:23.401936 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-948486f0-ef6a-482e-a6ad-54e2978573a6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:23.428967 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-948486f0-ef6a-482e-a6ad-54e2978573a6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:09:23.703190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-948486f0-ef6a-482e-a6ad-54e2978573a6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 204 len: 0 microversion: 2.1 time: 0.314317 Jul 14 11:09:23.708485 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 177/363] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:09:23 2022] DELETE /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:09:23.714324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c2ac0298-bbca-4fd1-aacd-6aaaf42014f5 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:23.715008 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c2ac0298-bbca-4fd1-aacd-6aaaf42014f5 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:23.722430 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ac0298-bbca-4fd1-aacd-6aaaf42014f5 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:23.722820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ac0298-bbca-4fd1-aacd-6aaaf42014f5 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:23.723728 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ac0298-bbca-4fd1-aacd-6aaaf42014f5 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:23.724164 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ac0298-bbca-4fd1-aacd-6aaaf42014f5 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:23.734258 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-10803c83-ea8d-45e6-b5ad-32e1e335bef0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:23.735187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-10803c83-ea8d-45e6-b5ad-32e1e335bef0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:23.742957 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-10803c83-ea8d-45e6-b5ad-32e1e335bef0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:23.743699 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-10803c83-ea8d-45e6-b5ad-32e1e335bef0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:23.744666 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-10803c83-ea8d-45e6-b5ad-32e1e335bef0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:23.745374 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-10803c83-ea8d-45e6-b5ad-32e1e335bef0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:23.891180 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c2ac0298-bbca-4fd1-aacd-6aaaf42014f5 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:23.899198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c2ac0298-bbca-4fd1-aacd-6aaaf42014f5 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1470 microversion: 2.1 time: 0.188985 Jul 14 11:09:23.900198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 187/364] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:23 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:23.940826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-10803c83-ea8d-45e6-b5ad-32e1e335bef0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:23.950683 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-10803c83-ea8d-45e6-b5ad-32e1e335bef0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.220375 Jul 14 11:09:23.951265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 178/365] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:23 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:24.031233 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:24.031801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:24.038196 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:24.038639 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:24.039978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:24.040412 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:24.055357 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] HTTP exception thrown: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Request method failure captured: Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d HTTP/1.1 Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jvQExo1KObnwjYfhFBPYnA_cGfrmZQBViIwLOweB909CZNNxCP2OFRoM40nc-8tfDOi6sQ-jmxOfWhmmHaCwPSZBRYK2KKiWDqbCR5s1bEO-2qvKC3xosxmgZjpRbPVp6fUImZBbIhQuQRwkHSMYoUVKwMMX1aDjfO0iSuUFQFMak Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: a90a870ee4154287be1282b3f46bdd05 Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:09:24.060615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a90a870ee4154287be1282b3f46bdd05", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a90a870ee4154287be1282b3f46bdd05 Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-DeleteServersTestJSON-82034498-project Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: f330cdfd7d2b47a985d8dc76c19da9a4 Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-DeleteServersTestJSON-82034498-project Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.062307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd15adbd9-9e3f-4368-8dc4-45ecc5436d5d'} Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:09:24.063078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.064367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.065556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Returning 404 to user: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:09:24.065556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bef5786a-b8a5-41ba-b56a-baf50fb63385 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 404 len: 111 microversion: 2.1 time: 0.035231 Jul 14 11:09:24.065556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 188/366] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:24 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:09:24.180655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:24.181647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:24.187894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:24.188355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:24.189418 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:24.192029 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:24.207213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] HTTP exception thrown: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Request method failure captured: Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d/os-volume_attachments HTTP/1.1 Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_jvQExo1KObnwjYfhFBPYnA_cGfrmZQBViIwLOweB909CZNNxCP2OFRoM40nc-8tfDOi6sQ-jmxOfWhmmHaCwPSZBRYK2KKiWDqbCR5s1bEO-2qvKC3xosxmgZjpRbPVp6fUImZBbIhQuQRwkHSMYoUVKwMMX1aDjfO0iSuUFQFMak Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: a90a870ee4154287be1282b3f46bdd05 Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:09:24.211326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a90a870ee4154287be1282b3f46bdd05", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: a90a870ee4154287be1282b3f46bdd05 Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-DeleteServersTestJSON-82034498-project Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: f330cdfd7d2b47a985d8dc76c19da9a4 Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-DeleteServersTestJSON-82034498-project Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.213463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'server_id': 'd15adbd9-9e3f-4368-8dc4-45ecc5436d5d'} Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:09:24.214789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:24.216698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:24.220250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Returning 404 to user: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:09:24.220250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2de0f5e3-c751-4593-a192-7cc4dc062e8e tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036985 Jul 14 11:09:24.220250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 179/367] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:09:24 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:09:24.918837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-736853a4-ac29-4191-a0d2-9c900e3b9cad tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:24.919652 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-736853a4-ac29-4191-a0d2-9c900e3b9cad tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:24.926065 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-736853a4-ac29-4191-a0d2-9c900e3b9cad tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:24.926507 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-736853a4-ac29-4191-a0d2-9c900e3b9cad tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:24.927631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-736853a4-ac29-4191-a0d2-9c900e3b9cad tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:24.928147 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-736853a4-ac29-4191-a0d2-9c900e3b9cad tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:24.971575 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0c2d49f9-c364-4fdd-93f0-d74e0045f01b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:24.973077 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0c2d49f9-c364-4fdd-93f0-d74e0045f01b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:24.997826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0c2d49f9-c364-4fdd-93f0-d74e0045f01b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:24.998643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0c2d49f9-c364-4fdd-93f0-d74e0045f01b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:25.000261 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0c2d49f9-c364-4fdd-93f0-d74e0045f01b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:25.001203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0c2d49f9-c364-4fdd-93f0-d74e0045f01b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:25.118805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-736853a4-ac29-4191-a0d2-9c900e3b9cad tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:25.127670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-736853a4-ac29-4191-a0d2-9c900e3b9cad tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1470 microversion: 2.1 time: 0.212453 Jul 14 11:09:25.135429 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 189/368] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:24 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1470 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:25.180694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0c2d49f9-c364-4fdd-93f0-d74e0045f01b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:25.194342 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0c2d49f9-c364-4fdd-93f0-d74e0045f01b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.230052 Jul 14 11:09:25.205365 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 180/369] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:24 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:25.444791 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:25.445425 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:25.452288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:25.452862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:25.453979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:25.454870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:25.473629 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] HTTP exception thrown: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Request method failure captured: Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d HTTP/1.1 Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jvQExo1KObnwjYfhFBPYnA_cGfrmZQBViIwLOweB909CZNNxCP2OFRoM40nc-8tfDOi6sQ-jmxOfWhmmHaCwPSZBRYK2KKiWDqbCR5s1bEO-2qvKC3xosxmgZjpRbPVp6fUImZBbIhQuQRwkHSMYoUVKwMMX1aDjfO0iSuUFQFMak Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: a90a870ee4154287be1282b3f46bdd05 Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:09:25.475295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a90a870ee4154287be1282b3f46bdd05", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a90a870ee4154287be1282b3f46bdd05 Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-DeleteServersTestJSON-82034498-project Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: f330cdfd7d2b47a985d8dc76c19da9a4 Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-DeleteServersTestJSON-82034498-project Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.478371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd15adbd9-9e3f-4368-8dc4-45ecc5436d5d'} Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:09:25.479817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.482053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.484557 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Returning 404 to user: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:09:25.484557 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-13354ac7-7178-42a7-b145-a4e24ff8e0d2 tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 404 len: 111 microversion: 2.1 time: 0.038583 Jul 14 11:09:25.484557 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 190/370] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:09:25 2022] DELETE /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:09:25.506190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:25.506836 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] [instance: d15adbd9-9e3f-4368-8dc4-45ecc5436d5d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:25.537210 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:25.538107 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:25.540780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:25.541526 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:25.559760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] HTTP exception thrown: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Request method failure captured: Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d HTTP/1.1 Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_jvQExo1KObnwjYfhFBPYnA_cGfrmZQBViIwLOweB909CZNNxCP2OFRoM40nc-8tfDOi6sQ-jmxOfWhmmHaCwPSZBRYK2KKiWDqbCR5s1bEO-2qvKC3xosxmgZjpRbPVp6fUImZBbIhQuQRwkHSMYoUVKwMMX1aDjfO0iSuUFQFMak Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: a90a870ee4154287be1282b3f46bdd05 Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:09:25.565838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a90a870ee4154287be1282b3f46bdd05", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a90a870ee4154287be1282b3f46bdd05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: a90a870ee4154287be1282b3f46bdd05 Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-DeleteServersTestJSON-82034498 Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-DeleteServersTestJSON-82034498-project Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: f330cdfd7d2b47a985d8dc76c19da9a4 Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-DeleteServersTestJSON-82034498-project Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.567616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'd15adbd9-9e3f-4368-8dc4-45ecc5436d5d'} Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:09:25.568281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. Jul 14 11:09:25.569353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:25.570292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] Returning 404 to user: Instance d15adbd9-9e3f-4368-8dc4-45ecc5436d5d could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:09:25.570292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0e348d82-6693-4414-8cc6-2f2025af3afc tempest-DeleteServersTestJSON-82034498 tempest-DeleteServersTestJSON-82034498-project] 10.222.0.75 "GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d" status: 404 len: 111 microversion: 2.1 time: 0.085156 Jul 14 11:09:25.575524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 181/371] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:25 2022] GET /compute/v2.1/servers/d15adbd9-9e3f-4368-8dc4-45ecc5436d5d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:09:26.154884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8bc73368-76a8-4edb-bebb-0dc7bec844d0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:26.156089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8bc73368-76a8-4edb-bebb-0dc7bec844d0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:26.165618 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bc73368-76a8-4edb-bebb-0dc7bec844d0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:26.166195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bc73368-76a8-4edb-bebb-0dc7bec844d0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:26.167267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bc73368-76a8-4edb-bebb-0dc7bec844d0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:26.167828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bc73368-76a8-4edb-bebb-0dc7bec844d0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:26.216143 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-113ea9a3-de39-4ad9-acd9-eebf94bb4271 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:26.216910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-113ea9a3-de39-4ad9-acd9-eebf94bb4271 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:26.228494 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-113ea9a3-de39-4ad9-acd9-eebf94bb4271 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:26.229057 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-113ea9a3-de39-4ad9-acd9-eebf94bb4271 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:26.230050 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-113ea9a3-de39-4ad9-acd9-eebf94bb4271 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:26.230710 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-113ea9a3-de39-4ad9-acd9-eebf94bb4271 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:26.426236 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8bc73368-76a8-4edb-bebb-0dc7bec844d0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:26.438992 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8bc73368-76a8-4edb-bebb-0dc7bec844d0 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1470 microversion: 2.1 time: 0.288481 Jul 14 11:09:26.440238 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 191/372] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:26 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:26.666074 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-113ea9a3-de39-4ad9-acd9-eebf94bb4271 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:26.677751 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-113ea9a3-de39-4ad9-acd9-eebf94bb4271 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.468289 Jul 14 11:09:26.680390 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 182/373] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:26 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:27.072249 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b4a47cb7-0e6e-452b-b5d0-8242bf571abc req-4bfb35f4-d5ef-439e-b3d7-6549a5cecc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbdd94c-50a9-4ee5-8660-d71902ee0cb4", "name": "network-vif-deleted", "tag": "40a0af58-23a9-4e89-930f-b6de42139ec4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:27.081631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b4a47cb7-0e6e-452b-b5d0-8242bf571abc req-4bfb35f4-d5ef-439e-b3d7-6549a5cecc84 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:27.082076 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b4a47cb7-0e6e-452b-b5d0-8242bf571abc req-4bfb35f4-d5ef-439e-b3d7-6549a5cecc84 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:27.095064 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b4a47cb7-0e6e-452b-b5d0-8242bf571abc req-4bfb35f4-d5ef-439e-b3d7-6549a5cecc84 service nova] Creating event network-vif-deleted:40a0af58-23a9-4e89-930f-b6de42139ec4 for instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 on hv-cinder-84893 Jul 14 11:09:27.101114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b4a47cb7-0e6e-452b-b5d0-8242bf571abc req-4bfb35f4-d5ef-439e-b3d7-6549a5cecc84 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035157 Jul 14 11:09:27.102806 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 192/374] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:27.463218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:27.464037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:27.471133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:27.471714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:27.472597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:27.473111 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:27.510656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:27.511102 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:27.511613 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lazy-loading 'fault' on Instance uuid 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:09:27.631023 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99127dff61834187834bff45137b5747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d40780d34214bc6974bcb658be6b3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:27.636143 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:27.641424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6c8636e2-05cd-45c3-a040-94c9cd473fd6 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 200 len: 1304 microversion: 2.1 time: 0.183001 Jul 14 11:09:27.653005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 183/375] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:27 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:27.697938 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89ab8abc-05c1-48a9-8ad5-175a2b2d8375 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:27.699236 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-89ab8abc-05c1-48a9-8ad5-175a2b2d8375 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:27.707334 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89ab8abc-05c1-48a9-8ad5-175a2b2d8375 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:27.708516 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89ab8abc-05c1-48a9-8ad5-175a2b2d8375 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:27.709603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89ab8abc-05c1-48a9-8ad5-175a2b2d8375 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:27.710214 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89ab8abc-05c1-48a9-8ad5-175a2b2d8375 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:27.887091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-89ab8abc-05c1-48a9-8ad5-175a2b2d8375 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:27.896168 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-89ab8abc-05c1-48a9-8ad5-175a2b2d8375 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.203149 Jul 14 11:09:27.899707 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 193/376] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:27 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:28.661370 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:28.662535 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] [instance: 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:28.672133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:28.684139 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:28.685240 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:28.685874 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:28.710080 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] HTTP exception thrown: Instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 could not be found. Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Request method failure captured: Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 HTTP/1.1 Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_lAdbW3lpDZOdQNbC-_xhMqAv5mAplu_xJLBZyfvaQduQNQMFQjgvEZNSqD64VUBGUgqCNdSe5IQ615RQx9MesqQ_mXByIDUND6FcCTGVGv8xKUPL5JPeNAw6UX0psBJYI6M6a3aJzOdRnWH-iQfslJSW7EJwa9z1PRygykwHryXok Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 6d40780d34214bc6974bcb658be6b3d2 Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesNegativeTest-126961215 Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:09:28.712483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/6d40780d34214bc6974bcb658be6b3d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_6d40780d34214bc6974bcb658be6b3d2", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/6d40780d34214bc6974bcb658be6b3d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/6d40780d34214bc6974bcb658be6b3d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesNegativeTest-126961215 Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 6d40780d34214bc6974bcb658be6b3d2 Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesNegativeTest-126961215 Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesNegativeTest-126961215-project Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 99127dff61834187834bff45137b5747 Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesNegativeTest-126961215-project Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 could not be found. Jul 14 11:09:28.713911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '5fbdd94c-50a9-4ee5-8660-d71902ee0cb4'} Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 could not be found. Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:09:28.714803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 could not be found. Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 could not be found. Jul 14 11:09:28.715848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:09:28.717667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] Returning 404 to user: Instance 5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:09:28.718688 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3507c3cc-7ad3-4c3a-9b1c-87a7a6dd4bb7 tempest-VolumesNegativeTest-126961215 tempest-VolumesNegativeTest-126961215-project] 10.222.0.75 "GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4" status: 404 len: 111 microversion: 2.1 time: 0.061351 Jul 14 11:09:28.727424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 184/377] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:28 2022] GET /compute/v2.1/servers/5fbdd94c-50a9-4ee5-8660-d71902ee0cb4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:09:28.915783 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6abc5ab-fb4a-4ed6-8495-0b5e646fdf2c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:28.917143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6abc5ab-fb4a-4ed6-8495-0b5e646fdf2c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:28.933900 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6abc5ab-fb4a-4ed6-8495-0b5e646fdf2c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:28.934509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6abc5ab-fb4a-4ed6-8495-0b5e646fdf2c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:28.947260 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6abc5ab-fb4a-4ed6-8495-0b5e646fdf2c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:28.949624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6abc5ab-fb4a-4ed6-8495-0b5e646fdf2c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:29.354699 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6abc5ab-fb4a-4ed6-8495-0b5e646fdf2c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:29.363437 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6abc5ab-fb4a-4ed6-8495-0b5e646fdf2c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.453495 Jul 14 11:09:29.364029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 194/378] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:28 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:30.381756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7f106897-8b8e-4539-addf-5dc5cf768ee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:30.382980 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7f106897-8b8e-4539-addf-5dc5cf768ee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:30.393935 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f106897-8b8e-4539-addf-5dc5cf768ee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:30.394656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f106897-8b8e-4539-addf-5dc5cf768ee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:30.395474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f106897-8b8e-4539-addf-5dc5cf768ee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:30.395915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f106897-8b8e-4539-addf-5dc5cf768ee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:30.593460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7f106897-8b8e-4539-addf-5dc5cf768ee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:30.607680 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7f106897-8b8e-4539-addf-5dc5cf768ee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.230297 Jul 14 11:09:30.608267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 185/379] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:30 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:31.628348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dd19768c-dd04-429d-8675-904ac56250a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:31.629859 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dd19768c-dd04-429d-8675-904ac56250a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:31.645804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd19768c-dd04-429d-8675-904ac56250a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:31.647417 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd19768c-dd04-429d-8675-904ac56250a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:31.650111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd19768c-dd04-429d-8675-904ac56250a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:31.650867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd19768c-dd04-429d-8675-904ac56250a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:31.842221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dd19768c-dd04-429d-8675-904ac56250a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:31.864738 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dd19768c-dd04-429d-8675-904ac56250a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.240498 Jul 14 11:09:31.866247 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 195/380] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:31 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:32.893302 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5eb7cd7c-0d89-455e-8f3b-260adb859151 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:32.894214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5eb7cd7c-0d89-455e-8f3b-260adb859151 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:32.904095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5eb7cd7c-0d89-455e-8f3b-260adb859151 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:32.904915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5eb7cd7c-0d89-455e-8f3b-260adb859151 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:32.906766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5eb7cd7c-0d89-455e-8f3b-260adb859151 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:32.908325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5eb7cd7c-0d89-455e-8f3b-260adb859151 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:33.145541 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5eb7cd7c-0d89-455e-8f3b-260adb859151 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:33.153424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5eb7cd7c-0d89-455e-8f3b-260adb859151 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.266837 Jul 14 11:09:33.154003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 186/381] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:32 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:34.172622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c81888b5-871e-4a6f-91e8-7a97be9a3ada tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:34.173235 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c81888b5-871e-4a6f-91e8-7a97be9a3ada tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:34.186914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c81888b5-871e-4a6f-91e8-7a97be9a3ada tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:34.187725 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c81888b5-871e-4a6f-91e8-7a97be9a3ada tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:34.188918 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c81888b5-871e-4a6f-91e8-7a97be9a3ada tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:34.190576 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c81888b5-871e-4a6f-91e8-7a97be9a3ada tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:34.604760 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c81888b5-871e-4a6f-91e8-7a97be9a3ada tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:34.621766 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c81888b5-871e-4a6f-91e8-7a97be9a3ada tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.452834 Jul 14 11:09:34.622952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 196/382] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:34 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:35.645845 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5920d516-f954-43ca-8d23-ec59f7b52747 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:35.649211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5920d516-f954-43ca-8d23-ec59f7b52747 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:35.661290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5920d516-f954-43ca-8d23-ec59f7b52747 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:35.663213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5920d516-f954-43ca-8d23-ec59f7b52747 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:35.666312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5920d516-f954-43ca-8d23-ec59f7b52747 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:35.666724 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5920d516-f954-43ca-8d23-ec59f7b52747 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:35.919218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5920d516-f954-43ca-8d23-ec59f7b52747 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:35.931186 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5920d516-f954-43ca-8d23-ec59f7b52747 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.294363 Jul 14 11:09:35.934228 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 187/383] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:35 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:36.952626 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-febe8456-8bda-4b0b-9097-30b5bf60e686 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:36.953613 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-febe8456-8bda-4b0b-9097-30b5bf60e686 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:36.967574 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-febe8456-8bda-4b0b-9097-30b5bf60e686 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:36.968035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-febe8456-8bda-4b0b-9097-30b5bf60e686 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:36.969964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-febe8456-8bda-4b0b-9097-30b5bf60e686 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:36.970523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-febe8456-8bda-4b0b-9097-30b5bf60e686 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:37.484578 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-febe8456-8bda-4b0b-9097-30b5bf60e686 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:37.509108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-febe8456-8bda-4b0b-9097-30b5bf60e686 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.561630 Jul 14 11:09:37.513185 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 197/384] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:36 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:38.533340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9ecbc14a-3292-4aca-80e2-c60738290936 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:38.534770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9ecbc14a-3292-4aca-80e2-c60738290936 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:38.542903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9ecbc14a-3292-4aca-80e2-c60738290936 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:38.543544 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9ecbc14a-3292-4aca-80e2-c60738290936 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:38.544706 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9ecbc14a-3292-4aca-80e2-c60738290936 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:38.545244 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9ecbc14a-3292-4aca-80e2-c60738290936 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:38.776872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9ecbc14a-3292-4aca-80e2-c60738290936 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:38.790733 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9ecbc14a-3292-4aca-80e2-c60738290936 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.261125 Jul 14 11:09:38.793740 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 188/385] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:38 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:39.031311 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2453a5b4-4795-472c-869e-c64dd28b435f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'create', calling method: .version_select at 0x7f579e120ee0>, body: {"keypair": {"name": "tempest-keypair-1644376790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXedBel/CjjoHmYwIrdX6+ngjd9ufqd3D03x97I+ZnvTSTjXTmGjMxfwHmI+y7touPLNY9RqxlxVYGY7dwlvGBkvJkhBLy0e7b60fZdHT0HVsWEL80YjnXeU+EpM1aBqA=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:39.057861 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-2453a5b4-4795-472c-869e-c64dd28b435f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Getting quotas for project a7cf89df79d64153a73a5ec4d49f376f. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:09:39.061720 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-2453a5b4-4795-472c-869e-c64dd28b435f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Getting quotas for user 5a7c1a5f674c4dfbb969ac37c5102408 and project a7cf89df79d64153a73a5ec4d49f376f. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:09:39.089881 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2453a5b4-4795-472c-869e-c64dd28b435f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.220029 Jul 14 11:09:39.090547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 198/386] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:09:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:39.810767 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a0580ff9-91c3-47d2-981c-cec21170cf01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:39.811451 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a0580ff9-91c3-47d2-981c-cec21170cf01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:39.818694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0580ff9-91c3-47d2-981c-cec21170cf01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:39.819377 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0580ff9-91c3-47d2-981c-cec21170cf01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:39.820519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0580ff9-91c3-47d2-981c-cec21170cf01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:39.820958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0580ff9-91c3-47d2-981c-cec21170cf01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:40.063944 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a0580ff9-91c3-47d2-981c-cec21170cf01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:40.093889 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a0580ff9-91c3-47d2-981c-cec21170cf01 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1520 microversion: 2.1 time: 0.286607 Jul 14 11:09:40.095333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 189/387] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:39 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:40.661707 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-306149415", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8eaca00-9ce0-454f-9fb3-291577542b1d"}], "security_groups": [{"name": "tempest-securitygroup--130985825"}], "key_name": "tempest-keypair-1644376790", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:40.854529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] validate_networks() for [('d8eaca00-9ce0-454f-9fb3-291577542b1d', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:09:41.113967 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-82555e52-efaf-48e0-8764-3ad993457c8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:41.115083 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-82555e52-efaf-48e0-8764-3ad993457c8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:41.128820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82555e52-efaf-48e0-8764-3ad993457c8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:41.129568 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82555e52-efaf-48e0-8764-3ad993457c8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:41.131202 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82555e52-efaf-48e0-8764-3ad993457c8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:41.132288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82555e52-efaf-48e0-8764-3ad993457c8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:41.350127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-82555e52-efaf-48e0-8764-3ad993457c8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:41.369675 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-82555e52-efaf-48e0-8764-3ad993457c8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1500 microversion: 2.1 time: 0.260377 Jul 14 11:09:41.371120 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 190/388] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:41 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1500 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:41.389440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:09:41.392298 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:09:41.393096 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:09:41.394017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:09:41.394709 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:09:41.399124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f3054f0d-b723-4a7f-a39d-373b9d100089 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:41.400497 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f3054f0d-b723-4a7f-a39d-373b9d100089 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:41.409876 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:41.411011 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3054f0d-b723-4a7f-a39d-373b9d100089 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:41.411241 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:41.411828 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3054f0d-b723-4a7f-a39d-373b9d100089 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:41.412820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:41.413259 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3054f0d-b723-4a7f-a39d-373b9d100089 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:41.414346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:41.414545 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3054f0d-b723-4a7f-a39d-373b9d100089 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:41.449125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Getting quotas for project a7cf89df79d64153a73a5ec4d49f376f. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:09:41.456886 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Getting quotas for user 5a7c1a5f674c4dfbb969ac37c5102408 and project a7cf89df79d64153a73a5ec4d49f376f. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:09:41.481266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:09:41.485810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:09:41.578860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b879b9ca-02c3-4e1a-affc-ff0da127cbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.920599 Jul 14 11:09:41.580000 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 199/389] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:09:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:09:41.605006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-56f50365-97c7-4be2-a2c0-81c4627940b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:41.606266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-56f50365-97c7-4be2-a2c0-81c4627940b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:41.642006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f3054f0d-b723-4a7f-a39d-373b9d100089 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:41.699099 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f3054f0d-b723-4a7f-a39d-373b9d100089 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1516 microversion: 2.1 time: 0.303095 Jul 14 11:09:41.700299 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 191/390] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:41 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:41.753524 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-56f50365-97c7-4be2-a2c0-81c4627940b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:41.777547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-56f50365-97c7-4be2-a2c0-81c4627940b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1237 microversion: 2.1 time: 0.180040 Jul 14 11:09:41.779080 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 200/391] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:41 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1237 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:42.809353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-34cdad1e-8eca-415c-adec-2b5ce47259c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:42.810366 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-34cdad1e-8eca-415c-adec-2b5ce47259c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:42.824865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34cdad1e-8eca-415c-adec-2b5ce47259c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:42.825913 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34cdad1e-8eca-415c-adec-2b5ce47259c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:42.827429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34cdad1e-8eca-415c-adec-2b5ce47259c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:42.828374 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34cdad1e-8eca-415c-adec-2b5ce47259c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:42.944308 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-34cdad1e-8eca-415c-adec-2b5ce47259c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:42.957218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-34cdad1e-8eca-415c-adec-2b5ce47259c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1241 microversion: 2.1 time: 0.155376 Jul 14 11:09:42.958397 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 192/392] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:42 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:43.985284 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f91c6c76-a1e6-403a-97b2-f76d7823adb1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:43.985999 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f91c6c76-a1e6-403a-97b2-f76d7823adb1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:43.992767 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f91c6c76-a1e6-403a-97b2-f76d7823adb1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:43.993222 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f91c6c76-a1e6-403a-97b2-f76d7823adb1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:43.994003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f91c6c76-a1e6-403a-97b2-f76d7823adb1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:43.994437 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f91c6c76-a1e6-403a-97b2-f76d7823adb1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:44.059763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f91c6c76-a1e6-403a-97b2-f76d7823adb1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:44.068268 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f91c6c76-a1e6-403a-97b2-f76d7823adb1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1241 microversion: 2.1 time: 0.090344 Jul 14 11:09:44.068908 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 201/393] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:43 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:45.085908 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bba0b3d4-b63d-4c8b-a458-7449ce4affc7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:45.086514 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bba0b3d4-b63d-4c8b-a458-7449ce4affc7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:45.093089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bba0b3d4-b63d-4c8b-a458-7449ce4affc7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:45.093557 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bba0b3d4-b63d-4c8b-a458-7449ce4affc7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:45.094343 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bba0b3d4-b63d-4c8b-a458-7449ce4affc7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:45.094773 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bba0b3d4-b63d-4c8b-a458-7449ce4affc7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:45.164455 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bba0b3d4-b63d-4c8b-a458-7449ce4affc7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:45.172269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bba0b3d4-b63d-4c8b-a458-7449ce4affc7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1289 microversion: 2.1 time: 0.090245 Jul 14 11:09:45.172857 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 193/394] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:45 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:46.222720 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-044c97be-90f5-4d04-9235-3572506266e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:46.223765 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-044c97be-90f5-4d04-9235-3572506266e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:46.232373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-044c97be-90f5-4d04-9235-3572506266e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:46.233240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-044c97be-90f5-4d04-9235-3572506266e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:46.234423 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-044c97be-90f5-4d04-9235-3572506266e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:46.234870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-044c97be-90f5-4d04-9235-3572506266e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:46.430300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-044c97be-90f5-4d04-9235-3572506266e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:46.437643 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-044c97be-90f5-4d04-9235-3572506266e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.248176 Jul 14 11:09:46.438360 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 202/395] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:46 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:46.755236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-037c8aaa-799f-4dcf-b5aa-87094541c017 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:46.756368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-037c8aaa-799f-4dcf-b5aa-87094541c017 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:46.764142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-037c8aaa-799f-4dcf-b5aa-87094541c017 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:46.764933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-037c8aaa-799f-4dcf-b5aa-87094541c017 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:46.765880 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-037c8aaa-799f-4dcf-b5aa-87094541c017 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:46.766334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-037c8aaa-799f-4dcf-b5aa-87094541c017 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:46.800610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-037c8aaa-799f-4dcf-b5aa-87094541c017 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lazy-loading 'flavor' on Instance uuid 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:09:46.978848 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e39dbca4-ebb7-4b91-bb67-22761f2f5657 req-bfcff625-3522-4fe8-8a30-d9c2ad91d60d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa194f91-d8c4-46f8-bbef-593b0e0fb64d", "tag": "96ec0c47-759f-4fc1-a1f6-482d3b2353f6"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:46.989071 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e39dbca4-ebb7-4b91-bb67-22761f2f5657 req-bfcff625-3522-4fe8-8a30-d9c2ad91d60d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:46.989764 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e39dbca4-ebb7-4b91-bb67-22761f2f5657 req-bfcff625-3522-4fe8-8a30-d9c2ad91d60d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:47.014269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-037c8aaa-799f-4dcf-b5aa-87094541c017 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b/action" status: 200 len: 32 microversion: 2.1 time: 0.262942 Jul 14 11:09:47.015084 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 194/396] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:09:46 2022] POST /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:09:47.019171 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e39dbca4-ebb7-4b91-bb67-22761f2f5657 req-bfcff625-3522-4fe8-8a30-d9c2ad91d60d service nova] Creating event network-changed:96ec0c47-759f-4fc1-a1f6-482d3b2353f6 for instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d on hv-cinder-84893 Jul 14 11:09:47.026481 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e39dbca4-ebb7-4b91-bb67-22761f2f5657 req-bfcff625-3522-4fe8-8a30-d9c2ad91d60d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053664 Jul 14 11:09:47.028216 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 203/397] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:47.028863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ee23c4a2-673c-45ca-90f6-829f610cf2ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:47.030553 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ee23c4a2-673c-45ca-90f6-829f610cf2ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:47.033930 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:47.045377 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee23c4a2-673c-45ca-90f6-829f610cf2ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:47.046292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee23c4a2-673c-45ca-90f6-829f610cf2ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:47.047978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee23c4a2-673c-45ca-90f6-829f610cf2ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:47.048673 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee23c4a2-673c-45ca-90f6-829f610cf2ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:47.243696 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ee23c4a2-673c-45ca-90f6-829f610cf2ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:47.251597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ee23c4a2-673c-45ca-90f6-829f610cf2ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.230347 Jul 14 11:09:47.252183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 195/398] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:47 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:47.462988 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9821f35a-98b7-4494-8d24-8fa47e076a7f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:47.463727 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9821f35a-98b7-4494-8d24-8fa47e076a7f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:47.471353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9821f35a-98b7-4494-8d24-8fa47e076a7f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:47.471858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9821f35a-98b7-4494-8d24-8fa47e076a7f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:47.472657 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9821f35a-98b7-4494-8d24-8fa47e076a7f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:47.473111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9821f35a-98b7-4494-8d24-8fa47e076a7f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:47.494440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:47.608335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9821f35a-98b7-4494-8d24-8fa47e076a7f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:47.616884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9821f35a-98b7-4494-8d24-8fa47e076a7f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.157629 Jul 14 11:09:47.617506 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 204/399] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:47 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:48.270092 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e64140c7-41d1-45ea-b39f-c8410a7244f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:48.270663 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e64140c7-41d1-45ea-b39f-c8410a7244f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:48.279302 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e64140c7-41d1-45ea-b39f-c8410a7244f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:48.280231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e64140c7-41d1-45ea-b39f-c8410a7244f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:48.281017 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e64140c7-41d1-45ea-b39f-c8410a7244f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:48.281673 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e64140c7-41d1-45ea-b39f-c8410a7244f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:48.435749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e64140c7-41d1-45ea-b39f-c8410a7244f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:48.448716 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e64140c7-41d1-45ea-b39f-c8410a7244f0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.182675 Jul 14 11:09:48.449761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 196/400] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:48 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:48.635858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-686fa9a0-52af-4831-8caf-ffd40840dd33 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:48.636728 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-686fa9a0-52af-4831-8caf-ffd40840dd33 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:48.643886 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-686fa9a0-52af-4831-8caf-ffd40840dd33 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:48.644538 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-686fa9a0-52af-4831-8caf-ffd40840dd33 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:48.645436 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-686fa9a0-52af-4831-8caf-ffd40840dd33 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:48.645977 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-686fa9a0-52af-4831-8caf-ffd40840dd33 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:48.786740 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-686fa9a0-52af-4831-8caf-ffd40840dd33 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:48.794840 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-686fa9a0-52af-4831-8caf-ffd40840dd33 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.164263 Jul 14 11:09:48.795432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 205/401] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:48 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:49.469219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cf7eac75-b3c4-4f51-946d-a01da41e309b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:49.469826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cf7eac75-b3c4-4f51-946d-a01da41e309b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:49.476694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf7eac75-b3c4-4f51-946d-a01da41e309b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:49.477139 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf7eac75-b3c4-4f51-946d-a01da41e309b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:49.477920 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf7eac75-b3c4-4f51-946d-a01da41e309b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:49.478355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf7eac75-b3c4-4f51-946d-a01da41e309b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:49.626183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cf7eac75-b3c4-4f51-946d-a01da41e309b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:49.634668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cf7eac75-b3c4-4f51-946d-a01da41e309b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.169308 Jul 14 11:09:49.635255 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 197/402] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:49 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:49.811922 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-baba178b-69ac-4d91-a839-6bb42f65e2e5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:49.812508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-baba178b-69ac-4d91-a839-6bb42f65e2e5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:49.818965 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-baba178b-69ac-4d91-a839-6bb42f65e2e5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:49.819337 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-baba178b-69ac-4d91-a839-6bb42f65e2e5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:49.820147 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-baba178b-69ac-4d91-a839-6bb42f65e2e5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:49.820582 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-baba178b-69ac-4d91-a839-6bb42f65e2e5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:49.963753 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-baba178b-69ac-4d91-a839-6bb42f65e2e5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:49.972556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-baba178b-69ac-4d91-a839-6bb42f65e2e5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.164377 Jul 14 11:09:49.973305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 206/403] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:49 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:50.651942 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9c1f3c00-2ade-42e9-967c-c36e1f66895d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:50.652808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9c1f3c00-2ade-42e9-967c-c36e1f66895d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:50.661121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c1f3c00-2ade-42e9-967c-c36e1f66895d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:50.661743 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c1f3c00-2ade-42e9-967c-c36e1f66895d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:50.663897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c1f3c00-2ade-42e9-967c-c36e1f66895d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:50.664671 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c1f3c00-2ade-42e9-967c-c36e1f66895d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:50.990262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-199b779d-7ed9-4e22-89da-dfd930ff166c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:50.990964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-199b779d-7ed9-4e22-89da-dfd930ff166c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:50.992815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:50.998348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-199b779d-7ed9-4e22-89da-dfd930ff166c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:50.998831 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-199b779d-7ed9-4e22-89da-dfd930ff166c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:50.999619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-199b779d-7ed9-4e22-89da-dfd930ff166c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:51.000047 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-199b779d-7ed9-4e22-89da-dfd930ff166c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:51.133882 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-199b779d-7ed9-4e22-89da-dfd930ff166c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:51.141856 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-199b779d-7ed9-4e22-89da-dfd930ff166c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.155426 Jul 14 11:09:51.142451 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 207/404] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:50 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:51.287323 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9c1f3c00-2ade-42e9-967c-c36e1f66895d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:51.295688 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9c1f3c00-2ade-42e9-967c-c36e1f66895d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.648526 Jul 14 11:09:51.296290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 198/405] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:50 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:52.159525 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-37aeb3db-3164-420a-bad7-57820f9fe74b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:52.160211 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-37aeb3db-3164-420a-bad7-57820f9fe74b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:52.162066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:52.163091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=12 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:52.168726 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-37aeb3db-3164-420a-bad7-57820f9fe74b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:52.169179 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-37aeb3db-3164-420a-bad7-57820f9fe74b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:52.169957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-37aeb3db-3164-420a-bad7-57820f9fe74b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:52.170395 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-37aeb3db-3164-420a-bad7-57820f9fe74b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:52.322227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e6a03fe8-9695-46a4-8790-71f4aa05e030 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:52.323054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e6a03fe8-9695-46a4-8790-71f4aa05e030 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:52.331221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6a03fe8-9695-46a4-8790-71f4aa05e030 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:52.331796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6a03fe8-9695-46a4-8790-71f4aa05e030 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:52.332748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6a03fe8-9695-46a4-8790-71f4aa05e030 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:52.333262 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6a03fe8-9695-46a4-8790-71f4aa05e030 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:52.338273 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-37aeb3db-3164-420a-bad7-57820f9fe74b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:52.347941 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-37aeb3db-3164-420a-bad7-57820f9fe74b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.192123 Jul 14 11:09:52.348992 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 208/406] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:52 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:52.351658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:52.494930 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e6a03fe8-9695-46a4-8790-71f4aa05e030 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:52.506636 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e6a03fe8-9695-46a4-8790-71f4aa05e030 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.189645 Jul 14 11:09:52.507829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 199/407] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:52 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:53.374566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7765a181-a47d-4c48-805c-5dbf40fcd2f3 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:53.375182 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7765a181-a47d-4c48-805c-5dbf40fcd2f3 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:53.381584 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7765a181-a47d-4c48-805c-5dbf40fcd2f3 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:53.382033 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7765a181-a47d-4c48-805c-5dbf40fcd2f3 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:53.382845 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7765a181-a47d-4c48-805c-5dbf40fcd2f3 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:53.383277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7765a181-a47d-4c48-805c-5dbf40fcd2f3 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:53.527141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7765a181-a47d-4c48-805c-5dbf40fcd2f3 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:53.530175 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4a6520ee-6f09-4678-a59a-73d6f61f81a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:53.530977 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4a6520ee-6f09-4678-a59a-73d6f61f81a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:53.536011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7765a181-a47d-4c48-805c-5dbf40fcd2f3 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.165174 Jul 14 11:09:53.536610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 209/408] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:53 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:53.537599 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a6520ee-6f09-4678-a59a-73d6f61f81a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:53.538596 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a6520ee-6f09-4678-a59a-73d6f61f81a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:53.539662 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a6520ee-6f09-4678-a59a-73d6f61f81a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:53.540103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a6520ee-6f09-4678-a59a-73d6f61f81a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:53.678480 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4a6520ee-6f09-4678-a59a-73d6f61f81a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:53.686978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4a6520ee-6f09-4678-a59a-73d6f61f81a6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.161750 Jul 14 11:09:53.687573 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 200/409] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:53 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:54.554335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-81160f1a-e8e8-40e4-a283-98a0f6bc605a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:54.554933 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-81160f1a-e8e8-40e4-a283-98a0f6bc605a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:54.561389 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81160f1a-e8e8-40e4-a283-98a0f6bc605a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:54.561927 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81160f1a-e8e8-40e4-a283-98a0f6bc605a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:54.562734 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81160f1a-e8e8-40e4-a283-98a0f6bc605a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:54.563201 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81160f1a-e8e8-40e4-a283-98a0f6bc605a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:54.704922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-35b4d136-0227-467d-a36c-1eba49d4cc7e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:54.705730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-81160f1a-e8e8-40e4-a283-98a0f6bc605a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:54.705970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-35b4d136-0227-467d-a36c-1eba49d4cc7e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:54.713368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-35b4d136-0227-467d-a36c-1eba49d4cc7e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:54.713821 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-35b4d136-0227-467d-a36c-1eba49d4cc7e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:54.714612 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-35b4d136-0227-467d-a36c-1eba49d4cc7e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:54.715105 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-35b4d136-0227-467d-a36c-1eba49d4cc7e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:54.725355 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-81160f1a-e8e8-40e4-a283-98a0f6bc605a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.175012 Jul 14 11:09:54.725970 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 210/410] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:54 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:54.865690 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-35b4d136-0227-467d-a36c-1eba49d4cc7e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:54.874148 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-35b4d136-0227-467d-a36c-1eba49d4cc7e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.173488 Jul 14 11:09:54.874728 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 201/411] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:54 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:55.744721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-23a595b1-d0ec-4f78-af51-e7a215497800 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:55.745419 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-23a595b1-d0ec-4f78-af51-e7a215497800 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:55.752153 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23a595b1-d0ec-4f78-af51-e7a215497800 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:55.752601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23a595b1-d0ec-4f78-af51-e7a215497800 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:55.753374 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23a595b1-d0ec-4f78-af51-e7a215497800 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:55.753818 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23a595b1-d0ec-4f78-af51-e7a215497800 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:55.890998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b2564ebf-5d8f-4f55-93a9-829d5f11abd6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:55.892316 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b2564ebf-5d8f-4f55-93a9-829d5f11abd6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:55.900519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b2564ebf-5d8f-4f55-93a9-829d5f11abd6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:55.901059 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b2564ebf-5d8f-4f55-93a9-829d5f11abd6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:55.901719 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b2564ebf-5d8f-4f55-93a9-829d5f11abd6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:55.902346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b2564ebf-5d8f-4f55-93a9-829d5f11abd6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:55.906549 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-23a595b1-d0ec-4f78-af51-e7a215497800 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:55.920789 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-23a595b1-d0ec-4f78-af51-e7a215497800 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.179965 Jul 14 11:09:55.922244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 211/412] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:55 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:56.060487 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b2564ebf-5d8f-4f55-93a9-829d5f11abd6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:56.069167 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b2564ebf-5d8f-4f55-93a9-829d5f11abd6 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.181937 Jul 14 11:09:56.069748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 202/413] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:55 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:56.940739 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef83a0a9-e458-4fad-bfec-f82279b548f0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:56.941510 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef83a0a9-e458-4fad-bfec-f82279b548f0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:56.948237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef83a0a9-e458-4fad-bfec-f82279b548f0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:56.948680 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef83a0a9-e458-4fad-bfec-f82279b548f0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:56.949445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef83a0a9-e458-4fad-bfec-f82279b548f0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:56.949868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef83a0a9-e458-4fad-bfec-f82279b548f0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:57.087600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4260dcf1-6e89-4840-a3ff-38e14de99cfe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:57.088353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4260dcf1-6e89-4840-a3ff-38e14de99cfe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:57.097392 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4260dcf1-6e89-4840-a3ff-38e14de99cfe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:57.097392 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4260dcf1-6e89-4840-a3ff-38e14de99cfe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:57.098348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4260dcf1-6e89-4840-a3ff-38e14de99cfe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:57.099259 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4260dcf1-6e89-4840-a3ff-38e14de99cfe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:57.112645 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ef83a0a9-e458-4fad-bfec-f82279b548f0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:57.120895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ef83a0a9-e458-4fad-bfec-f82279b548f0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.185175 Jul 14 11:09:57.121579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 212/414] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:56 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:57.256173 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4260dcf1-6e89-4840-a3ff-38e14de99cfe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:57.267716 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4260dcf1-6e89-4840-a3ff-38e14de99cfe tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.184603 Jul 14 11:09:57.268290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 203/415] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:57 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:58.138291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e5287880-d265-4ad9-9679-383ab2faf491 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:58.139052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e5287880-d265-4ad9-9679-383ab2faf491 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:58.145291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5287880-d265-4ad9-9679-383ab2faf491 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:58.145745 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5287880-d265-4ad9-9679-383ab2faf491 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:58.146525 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5287880-d265-4ad9-9679-383ab2faf491 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:58.146965 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5287880-d265-4ad9-9679-383ab2faf491 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:58.288414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e7cbb26b-ae80-4fbd-aae0-fbcb3e9b4e33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:58.289568 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e7cbb26b-ae80-4fbd-aae0-fbcb3e9b4e33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:58.298209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e5287880-d265-4ad9-9679-383ab2faf491 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:58.301608 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7cbb26b-ae80-4fbd-aae0-fbcb3e9b4e33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:58.302315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7cbb26b-ae80-4fbd-aae0-fbcb3e9b4e33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:58.303330 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7cbb26b-ae80-4fbd-aae0-fbcb3e9b4e33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:58.304294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7cbb26b-ae80-4fbd-aae0-fbcb3e9b4e33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:58.307009 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e5287880-d265-4ad9-9679-383ab2faf491 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.172614 Jul 14 11:09:58.314666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 213/416] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:58 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:58.457583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e7cbb26b-ae80-4fbd-aae0-fbcb3e9b4e33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:58.466158 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e7cbb26b-ae80-4fbd-aae0-fbcb3e9b4e33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.184606 Jul 14 11:09:58.468142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 204/417] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:58 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:59.324158 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f0272e5-ce38-4753-97c8-c68478a84fb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:59.324806 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f0272e5-ce38-4753-97c8-c68478a84fb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:59.331610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f0272e5-ce38-4753-97c8-c68478a84fb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:59.332053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f0272e5-ce38-4753-97c8-c68478a84fb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:59.332845 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f0272e5-ce38-4753-97c8-c68478a84fb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:59.333276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f0272e5-ce38-4753-97c8-c68478a84fb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:59.473640 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0f0272e5-ce38-4753-97c8-c68478a84fb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:59.481741 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f0272e5-ce38-4753-97c8-c68478a84fb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.161420 Jul 14 11:09:59.482345 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 214/418] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:59 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:59.484512 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bc51fac2-b4d0-45ad-ae1a-c6cfb4bc01ef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:59.485300 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bc51fac2-b4d0-45ad-ae1a-c6cfb4bc01ef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:59.492475 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc51fac2-b4d0-45ad-ae1a-c6cfb4bc01ef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:59.492927 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc51fac2-b4d0-45ad-ae1a-c6cfb4bc01ef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:59.493714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc51fac2-b4d0-45ad-ae1a-c6cfb4bc01ef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:59.494154 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc51fac2-b4d0-45ad-ae1a-c6cfb4bc01ef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:59.634784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bc51fac2-b4d0-45ad-ae1a-c6cfb4bc01ef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:59.642313 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bc51fac2-b4d0-45ad-ae1a-c6cfb4bc01ef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.162008 Jul 14 11:09:59.642962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 205/419] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:59 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:00.499402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-379b2771-74b0-40b8-ba14-8ff162c3b608 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:00.500062 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-379b2771-74b0-40b8-ba14-8ff162c3b608 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:00.506514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-379b2771-74b0-40b8-ba14-8ff162c3b608 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:00.507533 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-379b2771-74b0-40b8-ba14-8ff162c3b608 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:00.508321 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-379b2771-74b0-40b8-ba14-8ff162c3b608 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:00.508805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-379b2771-74b0-40b8-ba14-8ff162c3b608 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:00.661311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a5b4f24b-a74c-4e60-a7c9-aa728cce7243 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:00.662061 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a5b4f24b-a74c-4e60-a7c9-aa728cce7243 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:00.662219 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-379b2771-74b0-40b8-ba14-8ff162c3b608 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:00.669282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5b4f24b-a74c-4e60-a7c9-aa728cce7243 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:00.669736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5b4f24b-a74c-4e60-a7c9-aa728cce7243 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:00.670521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5b4f24b-a74c-4e60-a7c9-aa728cce7243 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:00.670639 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-379b2771-74b0-40b8-ba14-8ff162c3b608 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.175100 Jul 14 11:10:00.670963 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5b4f24b-a74c-4e60-a7c9-aa728cce7243 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:00.671172 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 215/420] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:00 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:00.814726 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a5b4f24b-a74c-4e60-a7c9-aa728cce7243 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:00.823424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a5b4f24b-a74c-4e60-a7c9-aa728cce7243 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.166605 Jul 14 11:10:00.824017 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 206/421] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:00 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:01.696334 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d960259a-eed7-4864-b16b-58bb4d6925a0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:01.697298 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d960259a-eed7-4864-b16b-58bb4d6925a0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:01.705206 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d960259a-eed7-4864-b16b-58bb4d6925a0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:01.705654 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d960259a-eed7-4864-b16b-58bb4d6925a0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:01.706473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d960259a-eed7-4864-b16b-58bb4d6925a0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:01.706909 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d960259a-eed7-4864-b16b-58bb4d6925a0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:01.841266 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4904b936-1d21-4b21-aac0-2fa0d15f477c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:01.841946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4904b936-1d21-4b21-aac0-2fa0d15f477c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:01.848316 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4904b936-1d21-4b21-aac0-2fa0d15f477c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:01.848770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4904b936-1d21-4b21-aac0-2fa0d15f477c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:01.849651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4904b936-1d21-4b21-aac0-2fa0d15f477c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:01.849985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4904b936-1d21-4b21-aac0-2fa0d15f477c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:01.852372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d960259a-eed7-4864-b16b-58bb4d6925a0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:01.861326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d960259a-eed7-4864-b16b-58bb4d6925a0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.169348 Jul 14 11:10:01.861992 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 216/422] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:01 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:02.009791 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4904b936-1d21-4b21-aac0-2fa0d15f477c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:02.025812 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4904b936-1d21-4b21-aac0-2fa0d15f477c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.188471 Jul 14 11:10:02.027622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 207/423] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:01 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:02.879046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-418645a4-dbf9-4eaf-a578-a078d2e6e548 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:02.879684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-418645a4-dbf9-4eaf-a578-a078d2e6e548 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:02.885892 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-418645a4-dbf9-4eaf-a578-a078d2e6e548 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:02.886340 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-418645a4-dbf9-4eaf-a578-a078d2e6e548 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:02.887112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-418645a4-dbf9-4eaf-a578-a078d2e6e548 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:02.887574 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-418645a4-dbf9-4eaf-a578-a078d2e6e548 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:03.027047 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-418645a4-dbf9-4eaf-a578-a078d2e6e548 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:03.036229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-418645a4-dbf9-4eaf-a578-a078d2e6e548 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.160930 Jul 14 11:10:03.036940 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 217/424] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:02 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:03.044496 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-522ebffc-9cb0-4fe6-aa5c-291e965afcce tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:03.045103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-522ebffc-9cb0-4fe6-aa5c-291e965afcce tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:03.052227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-522ebffc-9cb0-4fe6-aa5c-291e965afcce tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:03.052677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-522ebffc-9cb0-4fe6-aa5c-291e965afcce tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:03.054355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-522ebffc-9cb0-4fe6-aa5c-291e965afcce tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:03.054801 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-522ebffc-9cb0-4fe6-aa5c-291e965afcce tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:03.193063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-522ebffc-9cb0-4fe6-aa5c-291e965afcce tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:03.201304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-522ebffc-9cb0-4fe6-aa5c-291e965afcce tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.160578 Jul 14 11:10:03.202020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 208/425] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:03 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:04.054875 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-76d7cfde-1a8d-4f99-a503-3e785ac15254 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:04.055417 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-76d7cfde-1a8d-4f99-a503-3e785ac15254 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:04.064189 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76d7cfde-1a8d-4f99-a503-3e785ac15254 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:04.065092 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76d7cfde-1a8d-4f99-a503-3e785ac15254 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:04.066391 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76d7cfde-1a8d-4f99-a503-3e785ac15254 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:04.067162 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76d7cfde-1a8d-4f99-a503-3e785ac15254 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:04.218830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-28ae86ab-599e-4498-be92-02d4a11dd64e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:04.219524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-28ae86ab-599e-4498-be92-02d4a11dd64e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:04.224224 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-76d7cfde-1a8d-4f99-a503-3e785ac15254 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:04.228203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-28ae86ab-599e-4498-be92-02d4a11dd64e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:04.228655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-28ae86ab-599e-4498-be92-02d4a11dd64e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:04.229425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-28ae86ab-599e-4498-be92-02d4a11dd64e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:04.229854 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-28ae86ab-599e-4498-be92-02d4a11dd64e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:04.232472 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-76d7cfde-1a8d-4f99-a503-3e785ac15254 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.182577 Jul 14 11:10:04.233050 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 218/426] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:04 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:04.365402 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-28ae86ab-599e-4498-be92-02d4a11dd64e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:04.373289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-28ae86ab-599e-4498-be92-02d4a11dd64e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.158810 Jul 14 11:10:04.374108 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 209/427] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:04 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:05.248800 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62598cc5-ff62-485a-addc-4bc7dc847d0e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:05.249380 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62598cc5-ff62-485a-addc-4bc7dc847d0e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:05.255831 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62598cc5-ff62-485a-addc-4bc7dc847d0e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:05.256283 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62598cc5-ff62-485a-addc-4bc7dc847d0e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:05.257639 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62598cc5-ff62-485a-addc-4bc7dc847d0e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:05.258076 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62598cc5-ff62-485a-addc-4bc7dc847d0e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:05.394730 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fbd01590-90bf-4799-8f3c-f5d837e2705e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:05.396732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fbd01590-90bf-4799-8f3c-f5d837e2705e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:05.408118 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fbd01590-90bf-4799-8f3c-f5d837e2705e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:05.408893 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fbd01590-90bf-4799-8f3c-f5d837e2705e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:05.410282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fbd01590-90bf-4799-8f3c-f5d837e2705e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:05.411024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fbd01590-90bf-4799-8f3c-f5d837e2705e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:05.415326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62598cc5-ff62-485a-addc-4bc7dc847d0e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:05.423906 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62598cc5-ff62-485a-addc-4bc7dc847d0e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.178898 Jul 14 11:10:05.425117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 219/428] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:05 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:05.571108 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fbd01590-90bf-4799-8f3c-f5d837e2705e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:05.579053 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fbd01590-90bf-4799-8f3c-f5d837e2705e tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.191584 Jul 14 11:10:05.580129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 210/429] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:05 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:06.442014 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-24b015ed-eed3-4ee9-8c0b-eacbbf8becfb tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:06.442619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-24b015ed-eed3-4ee9-8c0b-eacbbf8becfb tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:06.449380 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24b015ed-eed3-4ee9-8c0b-eacbbf8becfb tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:06.449761 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24b015ed-eed3-4ee9-8c0b-eacbbf8becfb tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:06.450523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24b015ed-eed3-4ee9-8c0b-eacbbf8becfb tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:06.450958 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24b015ed-eed3-4ee9-8c0b-eacbbf8becfb tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:06.597684 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-611c9a54-56bf-4047-933e-403e3b821de2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:06.598481 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-611c9a54-56bf-4047-933e-403e3b821de2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:06.599239 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-24b015ed-eed3-4ee9-8c0b-eacbbf8becfb tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:06.605381 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-611c9a54-56bf-4047-933e-403e3b821de2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:06.605839 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-611c9a54-56bf-4047-933e-403e3b821de2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:06.606622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-611c9a54-56bf-4047-933e-403e3b821de2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:06.607060 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-611c9a54-56bf-4047-933e-403e3b821de2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:06.608724 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-24b015ed-eed3-4ee9-8c0b-eacbbf8becfb tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.170521 Jul 14 11:10:06.609600 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 220/430] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:06 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:06.747663 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-611c9a54-56bf-4047-933e-403e3b821de2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:06.755397 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-611c9a54-56bf-4047-933e-403e3b821de2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.161573 Jul 14 11:10:06.755988 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 211/431] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:06 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:07.446094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-9607b083-aa5d-4143-81aa-0adf46b73364 req-df1dbbb8-1bc6-470e-8370-11d0991aef39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa194f91-d8c4-46f8-bbef-593b0e0fb64d", "name": "network-vif-plugged", "status": "completed", "tag": "96ec0c47-759f-4fc1-a1f6-482d3b2353f6"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:07.464816 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9607b083-aa5d-4143-81aa-0adf46b73364 req-df1dbbb8-1bc6-470e-8370-11d0991aef39 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:07.465976 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9607b083-aa5d-4143-81aa-0adf46b73364 req-df1dbbb8-1bc6-470e-8370-11d0991aef39 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:07.472886 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:07.489312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-9607b083-aa5d-4143-81aa-0adf46b73364 req-df1dbbb8-1bc6-470e-8370-11d0991aef39 service nova] Creating event network-vif-plugged:96ec0c47-759f-4fc1-a1f6-482d3b2353f6 for instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d on hv-cinder-84893 Jul 14 11:10:07.499690 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-9607b083-aa5d-4143-81aa-0adf46b73364 req-df1dbbb8-1bc6-470e-8370-11d0991aef39 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060445 Jul 14 11:10:07.500552 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 221/432] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:07.632226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ed49a3fb-77e2-48ba-80e0-3f826d13f2b9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:07.633358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ed49a3fb-77e2-48ba-80e0-3f826d13f2b9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:07.644412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed49a3fb-77e2-48ba-80e0-3f826d13f2b9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:07.645229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed49a3fb-77e2-48ba-80e0-3f826d13f2b9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:07.646601 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed49a3fb-77e2-48ba-80e0-3f826d13f2b9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:07.648095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed49a3fb-77e2-48ba-80e0-3f826d13f2b9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:07.774551 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eb664e3c-9ba5-43de-be8f-44b4db965b16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:07.775257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eb664e3c-9ba5-43de-be8f-44b4db965b16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:07.781940 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb664e3c-9ba5-43de-be8f-44b4db965b16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:07.782349 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb664e3c-9ba5-43de-be8f-44b4db965b16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:07.783128 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb664e3c-9ba5-43de-be8f-44b4db965b16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:07.783599 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb664e3c-9ba5-43de-be8f-44b4db965b16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:07.815758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ed49a3fb-77e2-48ba-80e0-3f826d13f2b9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:07.826922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ed49a3fb-77e2-48ba-80e0-3f826d13f2b9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.202690 Jul 14 11:10:07.827538 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 212/433] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:07 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:07.952821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eb664e3c-9ba5-43de-be8f-44b4db965b16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:07.963329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eb664e3c-9ba5-43de-be8f-44b4db965b16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.193374 Jul 14 11:10:07.964083 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 222/434] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:07 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:08.843816 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-32995dfb-d1d9-47db-85b1-e470a04688f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:08.844380 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-32995dfb-d1d9-47db-85b1-e470a04688f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:08.851669 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32995dfb-d1d9-47db-85b1-e470a04688f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:08.852122 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32995dfb-d1d9-47db-85b1-e470a04688f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:08.852898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32995dfb-d1d9-47db-85b1-e470a04688f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:08.853396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32995dfb-d1d9-47db-85b1-e470a04688f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:08.990397 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a1975699-2e8e-431f-ba10-346bd2b93b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:08.992150 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a1975699-2e8e-431f-ba10-346bd2b93b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:09.002716 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1975699-2e8e-431f-ba10-346bd2b93b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:09.003624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1975699-2e8e-431f-ba10-346bd2b93b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:09.004697 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1975699-2e8e-431f-ba10-346bd2b93b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:09.005302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1975699-2e8e-431f-ba10-346bd2b93b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:09.011643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-32995dfb-d1d9-47db-85b1-e470a04688f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:09.029716 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-32995dfb-d1d9-47db-85b1-e470a04688f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.189646 Jul 14 11:10:09.030853 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 213/435] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:08 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:09.257851 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a1975699-2e8e-431f-ba10-346bd2b93b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:09.265936 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a1975699-2e8e-431f-ba10-346bd2b93b19 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.287878 Jul 14 11:10:09.266520 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 223/436] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:08 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:10.052783 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9b39dda4-10d0-4d95-8ca3-089a1edc1e34 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:10.054825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9b39dda4-10d0-4d95-8ca3-089a1edc1e34 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:10.063595 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b39dda4-10d0-4d95-8ca3-089a1edc1e34 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:10.064136 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b39dda4-10d0-4d95-8ca3-089a1edc1e34 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:10.064993 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b39dda4-10d0-4d95-8ca3-089a1edc1e34 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:10.065504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b39dda4-10d0-4d95-8ca3-089a1edc1e34 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:10.239437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b39dda4-10d0-4d95-8ca3-089a1edc1e34 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:10.247346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9b39dda4-10d0-4d95-8ca3-089a1edc1e34 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.200010 Jul 14 11:10:10.247968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 214/437] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:10 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:10.283306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7540daf2-f730-444b-9fd4-0a03888bd463 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:10.284143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7540daf2-f730-444b-9fd4-0a03888bd463 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:10.292381 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7540daf2-f730-444b-9fd4-0a03888bd463 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:10.293007 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7540daf2-f730-444b-9fd4-0a03888bd463 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:10.294169 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7540daf2-f730-444b-9fd4-0a03888bd463 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:10.294740 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7540daf2-f730-444b-9fd4-0a03888bd463 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:10.452566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7540daf2-f730-444b-9fd4-0a03888bd463 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:10.463413 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7540daf2-f730-444b-9fd4-0a03888bd463 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.184227 Jul 14 11:10:10.464257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 224/438] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:10 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:11.270277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b2e913e1-504f-4588-a88f-10855a762b37 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:11.271533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b2e913e1-504f-4588-a88f-10855a762b37 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:11.280545 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b2e913e1-504f-4588-a88f-10855a762b37 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:11.281186 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b2e913e1-504f-4588-a88f-10855a762b37 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:11.282548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b2e913e1-504f-4588-a88f-10855a762b37 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:11.283886 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b2e913e1-504f-4588-a88f-10855a762b37 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:11.441025 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b2e913e1-504f-4588-a88f-10855a762b37 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:11.444592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:11.450141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b2e913e1-504f-4588-a88f-10855a762b37 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1362 microversion: 2.1 time: 0.187987 Jul 14 11:10:11.450728 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 215/439] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:11 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:11.488064 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c8440cf-38b2-42a1-a0c2-4fb7dc39c3c5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:11.489102 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3c8440cf-38b2-42a1-a0c2-4fb7dc39c3c5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:11.496568 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c8440cf-38b2-42a1-a0c2-4fb7dc39c3c5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:11.510527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c8440cf-38b2-42a1-a0c2-4fb7dc39c3c5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:11.511413 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c8440cf-38b2-42a1-a0c2-4fb7dc39c3c5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:11.511862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c8440cf-38b2-42a1-a0c2-4fb7dc39c3c5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:11.688144 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c8440cf-38b2-42a1-a0c2-4fb7dc39c3c5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:11.695814 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3c8440cf-38b2-42a1-a0c2-4fb7dc39c3c5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.212337 Jul 14 11:10:11.696405 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 225/440] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:11 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:12.473097 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-def75257-5c60-4657-acdd-5d15a3ba689e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:12.473915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-def75257-5c60-4657-acdd-5d15a3ba689e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:12.481679 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-def75257-5c60-4657-acdd-5d15a3ba689e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:12.482272 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-def75257-5c60-4657-acdd-5d15a3ba689e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:12.483195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-def75257-5c60-4657-acdd-5d15a3ba689e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:12.483776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-def75257-5c60-4657-acdd-5d15a3ba689e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:12.648264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-def75257-5c60-4657-acdd-5d15a3ba689e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:12.656540 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-def75257-5c60-4657-acdd-5d15a3ba689e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1545 microversion: 2.1 time: 0.188364 Jul 14 11:10:12.657175 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 216/441] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:12 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1545 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:12.677259 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-28712edb-addc-4b8b-a919-2b0b4eabed35 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:12.678041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-28712edb-addc-4b8b-a919-2b0b4eabed35 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:12.687117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28712edb-addc-4b8b-a919-2b0b4eabed35 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:12.687915 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28712edb-addc-4b8b-a919-2b0b4eabed35 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:12.689158 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28712edb-addc-4b8b-a919-2b0b4eabed35 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:12.689801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28712edb-addc-4b8b-a919-2b0b4eabed35 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:12.717575 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c5fa3dd6-6612-4f8d-ab04-7b9eef5a4dcc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:12.719160 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c5fa3dd6-6612-4f8d-ab04-7b9eef5a4dcc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:12.731210 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5fa3dd6-6612-4f8d-ab04-7b9eef5a4dcc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:12.731878 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5fa3dd6-6612-4f8d-ab04-7b9eef5a4dcc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:12.733133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5fa3dd6-6612-4f8d-ab04-7b9eef5a4dcc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:12.733778 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5fa3dd6-6612-4f8d-ab04-7b9eef5a4dcc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:12.790789 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-28712edb-addc-4b8b-a919-2b0b4eabed35 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119386 Jul 14 11:10:12.791445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 226/442] 10.222.0.75 () {58 vars in 1274 bytes} [Thu Jul 14 11:10:12 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:13.117115 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c5fa3dd6-6612-4f8d-ab04-7b9eef5a4dcc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:13.128574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c5fa3dd6-6612-4f8d-ab04-7b9eef5a4dcc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1502 microversion: 2.1 time: 0.417618 Jul 14 11:10:13.129442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 217/443] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:12 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1502 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:13.145881 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4088daca-d2b9-40da-8c65-c604f2f797b4"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:13.147510 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:13.154319 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:13.154765 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:13.155596 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:13.156035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:13.188215 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] HTTP exception thrown: Cannot 'attach_volume' instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b while it is in vm_state rescued Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Request method failure captured: Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b/os-volume_attachments HTTP/1.1 Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 74 Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jzy9h1Afs0zs0rg7mjGvgG2X2oacoD26dWlQUtf-FovaBrL9N0VLYZ7co154V9baVMH9pm0O_AMwefnkDNKFUvb3NMjRak-11YX1GGW-wLFw7qg6AZf1dPN_XPxFsfrvSfcSfka3MOyF0cOnn4UTDGmmi3OcXqllY1XqLLVKI1kew Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:10:13.190003 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b3f043134a3d4369983f36769d2ae197", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: cb80e0c64c3348cfac5ad2c4f82fb606 Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {"volumeAttachment": {"volumeId": "4088daca-d2b9-40da-8c65-c604f2f797b4"}} Jul 14 11:10:13.192979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Cannot 'attach_volume' instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b while it is in vm_state rescued Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'server_id': '1bb87b2e-2f5d-429a-95a9-1af62edd1e2b', 'body': {'volumeAttachment': {'volumeId': '4088daca-d2b9-40da-8c65-c604f2f797b4'}}} Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:10:13.200035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b while it is in vm_state rescued Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:13.201335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:13.202509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:10:13.202509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:10:13.202509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b while it is in vm_state rescued Jul 14 11:10:13.202509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.202509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Returning 409 to user: Cannot 'attach_volume' instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b while it is in vm_state rescued {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:10:13.202509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-203e6236-9797-4d20-ad7b-e4e96be99912 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049990 Jul 14 11:10:13.202509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 227/444] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:10:13 2022] POST /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:10:13.205809 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-96e5daa2-e642-407d-9896-aa6ff7a02c16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:13.205809 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-96e5daa2-e642-407d-9896-aa6ff7a02c16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:13.212062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96e5daa2-e642-407d-9896-aa6ff7a02c16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:13.212521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96e5daa2-e642-407d-9896-aa6ff7a02c16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:13.214167 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96e5daa2-e642-407d-9896-aa6ff7a02c16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:13.214167 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96e5daa2-e642-407d-9896-aa6ff7a02c16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:13.289806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-96e5daa2-e642-407d-9896-aa6ff7a02c16 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b/action" status: 202 len: 0 microversion: 2.1 time: 0.088929 Jul 14 11:10:13.293718 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 218/445] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:10:13 2022] POST /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:10:13.299529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6f1101de-194c-4f00-8a18-0526350eac35 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:13.300138 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6f1101de-194c-4f00-8a18-0526350eac35 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:13.308027 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f1101de-194c-4f00-8a18-0526350eac35 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:13.308682 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f1101de-194c-4f00-8a18-0526350eac35 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:13.309772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f1101de-194c-4f00-8a18-0526350eac35 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:13.310326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f1101de-194c-4f00-8a18-0526350eac35 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:13.467601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6f1101de-194c-4f00-8a18-0526350eac35 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:13.476554 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6f1101de-194c-4f00-8a18-0526350eac35 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1510 microversion: 2.1 time: 0.181095 Jul 14 11:10:13.477257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 228/446] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:13 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:14.368837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-73deace0-ded2-4146-85f3-81ab4ec38d25 req-5518e0e4-6fd9-4d8b-a0e0-234bc2d2ef9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa194f91-d8c4-46f8-bbef-593b0e0fb64d", "tag": "96ec0c47-759f-4fc1-a1f6-482d3b2353f6"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:14.377355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-73deace0-ded2-4146-85f3-81ab4ec38d25 req-5518e0e4-6fd9-4d8b-a0e0-234bc2d2ef9b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:14.377785 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-73deace0-ded2-4146-85f3-81ab4ec38d25 req-5518e0e4-6fd9-4d8b-a0e0-234bc2d2ef9b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:14.389291 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-73deace0-ded2-4146-85f3-81ab4ec38d25 req-5518e0e4-6fd9-4d8b-a0e0-234bc2d2ef9b service nova] Creating event network-changed:96ec0c47-759f-4fc1-a1f6-482d3b2353f6 for instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d on hv-cinder-84893 Jul 14 11:10:14.394250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-73deace0-ded2-4146-85f3-81ab4ec38d25 req-5518e0e4-6fd9-4d8b-a0e0-234bc2d2ef9b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030602 Jul 14 11:10:14.394852 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 219/447] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:14.495505 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c13de0a4-2cc9-49a3-ac3a-082f93ca8d67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:14.496217 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c13de0a4-2cc9-49a3-ac3a-082f93ca8d67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:14.505501 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c13de0a4-2cc9-49a3-ac3a-082f93ca8d67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:14.506821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c13de0a4-2cc9-49a3-ac3a-082f93ca8d67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:14.508245 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c13de0a4-2cc9-49a3-ac3a-082f93ca8d67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:14.509081 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c13de0a4-2cc9-49a3-ac3a-082f93ca8d67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:14.658638 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c13de0a4-2cc9-49a3-ac3a-082f93ca8d67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:14.668890 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c13de0a4-2cc9-49a3-ac3a-082f93ca8d67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1510 microversion: 2.1 time: 0.177001 Jul 14 11:10:14.669737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 229/448] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:14 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:15.689065 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b6a1d1fa-5b4f-4dcb-b55b-312529266210 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:15.689757 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b6a1d1fa-5b4f-4dcb-b55b-312529266210 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:15.696580 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6a1d1fa-5b4f-4dcb-b55b-312529266210 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:15.697032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6a1d1fa-5b4f-4dcb-b55b-312529266210 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:15.697790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6a1d1fa-5b4f-4dcb-b55b-312529266210 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:15.698227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6a1d1fa-5b4f-4dcb-b55b-312529266210 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:15.833925 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b6a1d1fa-5b4f-4dcb-b55b-312529266210 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:15.841488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b6a1d1fa-5b4f-4dcb-b55b-312529266210 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1510 microversion: 2.1 time: 0.156915 Jul 14 11:10:15.842058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 220/449] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:15 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:16.859287 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-91bf4b87-f21e-4be6-b9c1-afae8f78a6c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:16.859897 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-91bf4b87-f21e-4be6-b9c1-afae8f78a6c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:16.873525 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91bf4b87-f21e-4be6-b9c1-afae8f78a6c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:16.873953 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91bf4b87-f21e-4be6-b9c1-afae8f78a6c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:16.874865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91bf4b87-f21e-4be6-b9c1-afae8f78a6c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:16.875312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91bf4b87-f21e-4be6-b9c1-afae8f78a6c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:17.047276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-91bf4b87-f21e-4be6-b9c1-afae8f78a6c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:17.055978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-91bf4b87-f21e-4be6-b9c1-afae8f78a6c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1510 microversion: 2.1 time: 0.200978 Jul 14 11:10:17.056569 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 230/450] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:16 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:18.074082 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-41a22763-aa9a-4dd1-9073-56617991eab9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:18.074830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-41a22763-aa9a-4dd1-9073-56617991eab9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:18.077300 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=52 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:18.082949 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-41a22763-aa9a-4dd1-9073-56617991eab9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:18.083403 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-41a22763-aa9a-4dd1-9073-56617991eab9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:18.084196 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-41a22763-aa9a-4dd1-9073-56617991eab9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:18.084793 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-41a22763-aa9a-4dd1-9073-56617991eab9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:18.222680 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-41a22763-aa9a-4dd1-9073-56617991eab9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:18.231345 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-41a22763-aa9a-4dd1-9073-56617991eab9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1510 microversion: 2.1 time: 0.161055 Jul 14 11:10:18.231997 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 221/451] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:18 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:19.250393 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5300e736-e8f6-4bdb-8a3e-c03a2f9fca3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:19.251259 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5300e736-e8f6-4bdb-8a3e-c03a2f9fca3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:19.258076 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5300e736-e8f6-4bdb-8a3e-c03a2f9fca3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:19.258548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5300e736-e8f6-4bdb-8a3e-c03a2f9fca3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:19.259368 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5300e736-e8f6-4bdb-8a3e-c03a2f9fca3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:19.260384 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5300e736-e8f6-4bdb-8a3e-c03a2f9fca3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:19.408117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5300e736-e8f6-4bdb-8a3e-c03a2f9fca3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:19.416266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5300e736-e8f6-4bdb-8a3e-c03a2f9fca3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1510 microversion: 2.1 time: 0.170024 Jul 14 11:10:19.416859 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 231/452] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:19 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:20.434915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6795db57-7f48-4019-b91b-02d00280d5b1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:20.435556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6795db57-7f48-4019-b91b-02d00280d5b1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:20.442265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6795db57-7f48-4019-b91b-02d00280d5b1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:20.442726 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6795db57-7f48-4019-b91b-02d00280d5b1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:20.444089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6795db57-7f48-4019-b91b-02d00280d5b1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:20.444532 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6795db57-7f48-4019-b91b-02d00280d5b1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:20.593141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6795db57-7f48-4019-b91b-02d00280d5b1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:20.602049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6795db57-7f48-4019-b91b-02d00280d5b1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1510 microversion: 2.1 time: 0.171231 Jul 14 11:10:20.602639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 222/453] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:20 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:21.629556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-397afe99-f9bd-475c-aae4-9d71c6aae5d7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:21.630085 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-397afe99-f9bd-475c-aae4-9d71c6aae5d7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:21.634023 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=50 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:21.638244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-397afe99-f9bd-475c-aae4-9d71c6aae5d7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:21.638984 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-397afe99-f9bd-475c-aae4-9d71c6aae5d7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:21.639804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-397afe99-f9bd-475c-aae4-9d71c6aae5d7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:21.640269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-397afe99-f9bd-475c-aae4-9d71c6aae5d7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:21.827617 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-397afe99-f9bd-475c-aae4-9d71c6aae5d7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:21.835669 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-397afe99-f9bd-475c-aae4-9d71c6aae5d7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1516 microversion: 2.1 time: 0.210177 Jul 14 11:10:21.836266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 232/454] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:21 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1516 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:23.283968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-522cc45c-f24e-4b82-9363-f628ed59d3f9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'create', calling method: .version_select at 0x7f579e0cb940>, body: {"keypair": {"name": "tempest-keypair-123089563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxU9ce/6lfSEJBXddoIxVtleNp93KCUBuKjaXhwaIRP9U2/vvdWx/jktsv6BAaFC4m/EU3yrdL0bj4NngbOilQDm086ffJWidbFdCFCQoniZnzNFPjaVUqhPotRAv5/wQ=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:23.303203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-522cc45c-f24e-4b82-9363-f628ed59d3f9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Getting quotas for project b3f043134a3d4369983f36769d2ae197. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:10:23.308502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-522cc45c-f24e-4b82-9363-f628ed59d3f9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Getting quotas for user cb80e0c64c3348cfac5ad2c4f82fb606 and project b3f043134a3d4369983f36769d2ae197. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:10:23.338962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-522cc45c-f24e-4b82-9363-f628ed59d3f9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059805 Jul 14 11:10:23.339591 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 223/455] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:10:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:10:25.050513 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-7027317", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "131ff080-99aa-4954-b49d-b15b1af99faa"}], "security_groups": [{"name": "tempest-securitygroup--374526628"}], "key_name": "tempest-keypair-123089563", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:25.190989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] validate_networks() for [('131ff080-99aa-4954-b49d-b15b1af99faa', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:10:25.705670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:10:25.706085 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:10:25.706553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:10:25.706958 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:10:25.707361 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:10:25.717142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:25.717585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:25.718732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:25.719173 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:25.737663 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Getting quotas for project b3f043134a3d4369983f36769d2ae197. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:10:25.741850 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Getting quotas for user cb80e0c64c3348cfac5ad2c4f82fb606 and project b3f043134a3d4369983f36769d2ae197. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:10:25.754072 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:10:25.756983 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:10:25.807281 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-185e3d19-81ef-4ed5-bf7a-be2917efc3f8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.760981 Jul 14 11:10:25.808898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 233/456] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:10:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:10:25.828587 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a709017b-68a8-4248-a927-a0208313a922 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:25.829771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a709017b-68a8-4248-a927-a0208313a922 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:25.934296 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a709017b-68a8-4248-a927-a0208313a922 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:25.953993 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a709017b-68a8-4248-a927-a0208313a922 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1242 microversion: 2.1 time: 0.138165 Jul 14 11:10:25.957211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 224/457] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:25 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:26.974270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-987f19b2-e5d5-4c31-b452-2abc3e5d9462 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:26.975462 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-987f19b2-e5d5-4c31-b452-2abc3e5d9462 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:26.981841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-987f19b2-e5d5-4c31-b452-2abc3e5d9462 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:26.982288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-987f19b2-e5d5-4c31-b452-2abc3e5d9462 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:26.983054 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-987f19b2-e5d5-4c31-b452-2abc3e5d9462 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:26.983517 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-987f19b2-e5d5-4c31-b452-2abc3e5d9462 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:27.047154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-987f19b2-e5d5-4c31-b452-2abc3e5d9462 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:27.054874 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-987f19b2-e5d5-4c31-b452-2abc3e5d9462 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1294 microversion: 2.1 time: 0.084612 Jul 14 11:10:27.055469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 234/458] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:26 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:28.074271 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a0ff5b49-fd1f-4e45-8458-349a6cdd08e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:28.074883 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a0ff5b49-fd1f-4e45-8458-349a6cdd08e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:28.083361 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0ff5b49-fd1f-4e45-8458-349a6cdd08e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:28.083908 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0ff5b49-fd1f-4e45-8458-349a6cdd08e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:28.084697 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0ff5b49-fd1f-4e45-8458-349a6cdd08e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:28.085138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0ff5b49-fd1f-4e45-8458-349a6cdd08e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:28.294090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a0ff5b49-fd1f-4e45-8458-349a6cdd08e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:28.301924 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a0ff5b49-fd1f-4e45-8458-349a6cdd08e7 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.231563 Jul 14 11:10:28.305354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 225/459] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:28 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:28.815661 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-76d7f675-f2fa-4974-bfae-69157233e504 req-92f02f11-43d7-4e9a-97ca-fd2382a6e7aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe2921e8-d6f6-4bcd-a5bd-a02da1353800", "tag": "8f073a5b-cf77-4431-946c-0d8651ac7527"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:28.829625 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-76d7f675-f2fa-4974-bfae-69157233e504 req-92f02f11-43d7-4e9a-97ca-fd2382a6e7aa service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:28.830128 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-76d7f675-f2fa-4974-bfae-69157233e504 req-92f02f11-43d7-4e9a-97ca-fd2382a6e7aa service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:28.847539 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-76d7f675-f2fa-4974-bfae-69157233e504 req-92f02f11-43d7-4e9a-97ca-fd2382a6e7aa service nova] Creating event network-changed:8f073a5b-cf77-4431-946c-0d8651ac7527 for instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 on hv-cinder-84893 Jul 14 11:10:28.854223 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-76d7f675-f2fa-4974-bfae-69157233e504 req-92f02f11-43d7-4e9a-97ca-fd2382a6e7aa service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044100 Jul 14 11:10:28.854839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 235/460] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:29.322534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-15b22786-0d5e-43a4-87ca-47125f128a3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:29.323062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-15b22786-0d5e-43a4-87ca-47125f128a3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:29.331361 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15b22786-0d5e-43a4-87ca-47125f128a3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:29.331847 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15b22786-0d5e-43a4-87ca-47125f128a3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:29.332628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15b22786-0d5e-43a4-87ca-47125f128a3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:29.333068 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15b22786-0d5e-43a4-87ca-47125f128a3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:29.472066 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-15b22786-0d5e-43a4-87ca-47125f128a3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:29.479364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-15b22786-0d5e-43a4-87ca-47125f128a3c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.161379 Jul 14 11:10:29.479954 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 226/461] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:29 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:30.497576 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4319c8ff-950f-45f0-8fd8-14d7089a3713 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:30.498270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4319c8ff-950f-45f0-8fd8-14d7089a3713 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:30.505137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4319c8ff-950f-45f0-8fd8-14d7089a3713 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:30.505584 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4319c8ff-950f-45f0-8fd8-14d7089a3713 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:30.506351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4319c8ff-950f-45f0-8fd8-14d7089a3713 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:30.506783 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4319c8ff-950f-45f0-8fd8-14d7089a3713 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:30.641844 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4319c8ff-950f-45f0-8fd8-14d7089a3713 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:30.649946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4319c8ff-950f-45f0-8fd8-14d7089a3713 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.156566 Jul 14 11:10:30.650978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 236/462] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:30 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:31.666483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ffd16fab-e261-4e87-86cb-b80b23af0bef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:31.667090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ffd16fab-e261-4e87-86cb-b80b23af0bef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:31.673933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffd16fab-e261-4e87-86cb-b80b23af0bef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:31.674389 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffd16fab-e261-4e87-86cb-b80b23af0bef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:31.675167 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffd16fab-e261-4e87-86cb-b80b23af0bef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:31.675638 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffd16fab-e261-4e87-86cb-b80b23af0bef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:31.817307 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ffd16fab-e261-4e87-86cb-b80b23af0bef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:31.824872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ffd16fab-e261-4e87-86cb-b80b23af0bef tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.162191 Jul 14 11:10:31.825436 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 227/463] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:31 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:32.841707 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d154e9f2-6cf9-4de5-a9b4-868615b064a0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:32.842470 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d154e9f2-6cf9-4de5-a9b4-868615b064a0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:32.848649 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d154e9f2-6cf9-4de5-a9b4-868615b064a0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:32.849100 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d154e9f2-6cf9-4de5-a9b4-868615b064a0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:32.850417 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d154e9f2-6cf9-4de5-a9b4-868615b064a0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:32.850850 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d154e9f2-6cf9-4de5-a9b4-868615b064a0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:32.990768 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d154e9f2-6cf9-4de5-a9b4-868615b064a0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:32.998297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d154e9f2-6cf9-4de5-a9b4-868615b064a0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.160664 Jul 14 11:10:32.998863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 237/464] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:32 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:34.015339 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c77dc6fd-f687-462e-a6a8-d2cb098142e9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:34.015960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c77dc6fd-f687-462e-a6a8-d2cb098142e9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:34.022748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c77dc6fd-f687-462e-a6a8-d2cb098142e9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:34.023193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c77dc6fd-f687-462e-a6a8-d2cb098142e9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:34.023979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c77dc6fd-f687-462e-a6a8-d2cb098142e9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:34.024408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c77dc6fd-f687-462e-a6a8-d2cb098142e9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:34.413714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c77dc6fd-f687-462e-a6a8-d2cb098142e9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:34.421356 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c77dc6fd-f687-462e-a6a8-d2cb098142e9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.409900 Jul 14 11:10:34.421937 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 228/465] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:34 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:35.438725 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7156447d-3906-4a26-a35d-5ac209482847 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:35.439317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7156447d-3906-4a26-a35d-5ac209482847 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:35.446431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7156447d-3906-4a26-a35d-5ac209482847 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:35.446869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7156447d-3906-4a26-a35d-5ac209482847 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:35.448185 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7156447d-3906-4a26-a35d-5ac209482847 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:35.448185 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7156447d-3906-4a26-a35d-5ac209482847 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:35.592774 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7156447d-3906-4a26-a35d-5ac209482847 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:35.600737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7156447d-3906-4a26-a35d-5ac209482847 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.166113 Jul 14 11:10:35.601311 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 238/466] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:35 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:36.616832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f510c050-8851-41af-aaf5-ac6b600477e2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:36.617383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f510c050-8851-41af-aaf5-ac6b600477e2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:36.619852 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:36.625475 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f510c050-8851-41af-aaf5-ac6b600477e2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:36.625887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f510c050-8851-41af-aaf5-ac6b600477e2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:36.626659 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f510c050-8851-41af-aaf5-ac6b600477e2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:36.627968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f510c050-8851-41af-aaf5-ac6b600477e2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:36.772431 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f510c050-8851-41af-aaf5-ac6b600477e2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:36.782070 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f510c050-8851-41af-aaf5-ac6b600477e2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.169216 Jul 14 11:10:36.782661 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 229/467] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:36 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:37.798141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3de51c8a-4acc-4d37-9003-ae3063c19961 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:37.798745 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3de51c8a-4acc-4d37-9003-ae3063c19961 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:37.800764 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:37.801499 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:37.813299 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3de51c8a-4acc-4d37-9003-ae3063c19961 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:37.813751 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3de51c8a-4acc-4d37-9003-ae3063c19961 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:37.814541 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3de51c8a-4acc-4d37-9003-ae3063c19961 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:37.814977 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3de51c8a-4acc-4d37-9003-ae3063c19961 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:37.818106 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=91 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:38.175197 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3de51c8a-4acc-4d37-9003-ae3063c19961 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:38.183897 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3de51c8a-4acc-4d37-9003-ae3063c19961 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.389508 Jul 14 11:10:38.184484 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 239/468] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:37 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:39.201682 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a9548efe-1876-4dc2-bf11-d789ffce411b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:39.202288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a9548efe-1876-4dc2-bf11-d789ffce411b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:39.208896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9548efe-1876-4dc2-bf11-d789ffce411b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:39.209344 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9548efe-1876-4dc2-bf11-d789ffce411b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:39.210185 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9548efe-1876-4dc2-bf11-d789ffce411b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:39.210624 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9548efe-1876-4dc2-bf11-d789ffce411b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:39.339771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a9548efe-1876-4dc2-bf11-d789ffce411b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:39.347215 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a9548efe-1876-4dc2-bf11-d789ffce411b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.149379 Jul 14 11:10:39.347807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 230/469] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:39 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:40.053574 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-ad57b3ff-414f-42a3-8d06-008bac4f7ec5 req-ea467669-e265-48eb-9646-f4007bc20aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2921e8-d6f6-4bcd-a5bd-a02da1353800", "name": "network-vif-plugged", "status": "completed", "tag": "8f073a5b-cf77-4431-946c-0d8651ac7527"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:40.062100 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ad57b3ff-414f-42a3-8d06-008bac4f7ec5 req-ea467669-e265-48eb-9646-f4007bc20aec service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:40.062538 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ad57b3ff-414f-42a3-8d06-008bac4f7ec5 req-ea467669-e265-48eb-9646-f4007bc20aec service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:40.075084 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-ad57b3ff-414f-42a3-8d06-008bac4f7ec5 req-ea467669-e265-48eb-9646-f4007bc20aec service nova] Creating event network-vif-plugged:8f073a5b-cf77-4431-946c-0d8651ac7527 for instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 on hv-cinder-84893 Jul 14 11:10:40.080304 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-ad57b3ff-414f-42a3-8d06-008bac4f7ec5 req-ea467669-e265-48eb-9646-f4007bc20aec service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031034 Jul 14 11:10:40.081162 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 240/470] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:40.364550 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e80c5260-5ee6-402c-8067-3e958f76fa8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:40.365157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e80c5260-5ee6-402c-8067-3e958f76fa8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:40.371636 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80c5260-5ee6-402c-8067-3e958f76fa8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:40.372088 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80c5260-5ee6-402c-8067-3e958f76fa8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:40.372859 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80c5260-5ee6-402c-8067-3e958f76fa8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:40.373291 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80c5260-5ee6-402c-8067-3e958f76fa8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:40.504647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e80c5260-5ee6-402c-8067-3e958f76fa8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:40.513300 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e80c5260-5ee6-402c-8067-3e958f76fa8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.152507 Jul 14 11:10:40.513923 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 231/471] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:40 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:41.530814 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb2f53e9-5627-4d04-be0d-3c790f360697 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:41.531460 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb2f53e9-5627-4d04-be0d-3c790f360697 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:41.538285 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb2f53e9-5627-4d04-be0d-3c790f360697 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:41.538732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb2f53e9-5627-4d04-be0d-3c790f360697 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:41.539534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb2f53e9-5627-4d04-be0d-3c790f360697 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:41.539975 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb2f53e9-5627-4d04-be0d-3c790f360697 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:41.674585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb2f53e9-5627-4d04-be0d-3c790f360697 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:41.682792 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb2f53e9-5627-4d04-be0d-3c790f360697 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1367 microversion: 2.1 time: 0.156299 Jul 14 11:10:41.683389 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 241/472] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:41 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:42.699686 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cb06a1df-ae68-477b-9cbf-ebc85220f4d4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:42.700401 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cb06a1df-ae68-477b-9cbf-ebc85220f4d4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:42.706873 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cb06a1df-ae68-477b-9cbf-ebc85220f4d4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:42.707347 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cb06a1df-ae68-477b-9cbf-ebc85220f4d4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:42.708144 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cb06a1df-ae68-477b-9cbf-ebc85220f4d4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:42.709079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cb06a1df-ae68-477b-9cbf-ebc85220f4d4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:42.711926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:42.855119 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cb06a1df-ae68-477b-9cbf-ebc85220f4d4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:10:42.862764 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cb06a1df-ae68-477b-9cbf-ebc85220f4d4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1560 microversion: 2.1 time: 0.167008 Jul 14 11:10:42.863337 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 232/473] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:10:42 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:10:42.878760 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0815e701-c885-4290-a6a7-ed6d46647ea3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:42.879301 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0815e701-c885-4290-a6a7-ed6d46647ea3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:10:42.885835 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0815e701-c885-4290-a6a7-ed6d46647ea3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:42.886289 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0815e701-c885-4290-a6a7-ed6d46647ea3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:42.887058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0815e701-c885-4290-a6a7-ed6d46647ea3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:42.887522 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0815e701-c885-4290-a6a7-ed6d46647ea3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:42.968429 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0815e701-c885-4290-a6a7-ed6d46647ea3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093566 Jul 14 11:10:42.969028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 242/474] 10.222.0.75 () {58 vars in 1274 bytes} [Thu Jul 14 11:10:42 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:43.911030 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-35448c58-4938-44fa-8ef6-663c7c25951c req-13f1c435-2bcd-4e0b-80df-48cf119cabe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe2921e8-d6f6-4bcd-a5bd-a02da1353800", "tag": "8f073a5b-cf77-4431-946c-0d8651ac7527"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:43.919721 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-35448c58-4938-44fa-8ef6-663c7c25951c req-13f1c435-2bcd-4e0b-80df-48cf119cabe5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:10:43.920245 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-35448c58-4938-44fa-8ef6-663c7c25951c req-13f1c435-2bcd-4e0b-80df-48cf119cabe5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:10:43.931876 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-35448c58-4938-44fa-8ef6-663c7c25951c req-13f1c435-2bcd-4e0b-80df-48cf119cabe5 service nova] Creating event network-changed:8f073a5b-cf77-4431-946c-0d8651ac7527 for instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 on hv-cinder-84893 Jul 14 11:10:43.937293 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-35448c58-4938-44fa-8ef6-663c7c25951c req-13f1c435-2bcd-4e0b-80df-48cf119cabe5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029893 Jul 14 11:10:43.938064 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 233/475] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:52.092058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:10:52.092756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:10:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:11:19.156284 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:19.157078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=17 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:19.161634 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d8fa051e-531c-4a33-9f7e-f31074842c3b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:19.162125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d8fa051e-531c-4a33-9f7e-f31074842c3b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:19.170502 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8fa051e-531c-4a33-9f7e-f31074842c3b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:19.170960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8fa051e-531c-4a33-9f7e-f31074842c3b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:19.171767 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8fa051e-531c-4a33-9f7e-f31074842c3b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:19.172198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8fa051e-531c-4a33-9f7e-f31074842c3b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:19.200107 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d8fa051e-531c-4a33-9f7e-f31074842c3b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/ips" status: 200 len: 149 microversion: 2.1 time: 0.044788 Jul 14 11:11:19.200895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 243/476] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:11:19 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:20.545661 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:20.546470 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=7 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:20.550642 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2184023d-540c-4498-95c9-26f740fffd80 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:20.551820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2184023d-540c-4498-95c9-26f740fffd80 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:20.559962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2184023d-540c-4498-95c9-26f740fffd80 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:20.560413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2184023d-540c-4498-95c9-26f740fffd80 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:20.561188 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2184023d-540c-4498-95c9-26f740fffd80 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:20.561626 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2184023d-540c-4498-95c9-26f740fffd80 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:20.580491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c696783a-c9eb-46c2-9fd8-b70a7ca9f081 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "245b2af1-7f49-40ed-8d3b-b92d03d180e1"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:20.581659 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c696783a-c9eb-46c2-9fd8-b70a7ca9f081 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:20.586223 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2184023d-540c-4498-95c9-26f740fffd80 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/ips" status: 200 len: 153 microversion: 2.20 time: 0.042237 Jul 14 11:11:20.586802 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 234/477] 10.222.0.75 () {60 vars in 1288 bytes} [Thu Jul 14 11:11:20 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:11:20.587943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c696783a-c9eb-46c2-9fd8-b70a7ca9f081 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:20.588398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c696783a-c9eb-46c2-9fd8-b70a7ca9f081 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:20.589172 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c696783a-c9eb-46c2-9fd8-b70a7ca9f081 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:20.589615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c696783a-c9eb-46c2-9fd8-b70a7ca9f081 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:20.910833 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c696783a-c9eb-46c2-9fd8-b70a7ca9f081 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333605 Jul 14 11:11:20.912109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 244/478] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:11:20 2022] POST /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:11:22.442358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-abf0d3df-64c3-48e8-833b-9928f27d8e75 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:22.442915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-abf0d3df-64c3-48e8-833b-9928f27d8e75 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:22.449291 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-abf0d3df-64c3-48e8-833b-9928f27d8e75 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:22.449756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-abf0d3df-64c3-48e8-833b-9928f27d8e75 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:22.450519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-abf0d3df-64c3-48e8-833b-9928f27d8e75 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:22.450968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-abf0d3df-64c3-48e8-833b-9928f27d8e75 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:22.474452 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-abf0d3df-64c3-48e8-833b-9928f27d8e75 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lazy-loading 'flavor' on Instance uuid 4d03bde1-0583-4099-8098-0077a2fc1084 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:11:22.728537 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-abf0d3df-64c3-48e8-833b-9928f27d8e75 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/action" status: 202 len: 0 microversion: 2.20 time: 0.290037 Jul 14 11:11:22.729319 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 235/479] 10.222.0.75 () {62 vars in 1318 bytes} [Thu Jul 14 11:11:22 2022] POST /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:11:22.738902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:22.739651 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:22.746475 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:22.747244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:22.748092 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:22.748530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:22.884201 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:22.892114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:22.893608 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:22.894810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-89dc29d9-9ef8-48f2-9d30-2f963aacd001 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.161207 Jul 14 11:11:22.895361 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 245/480] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:22 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:23.914640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:23.915368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:23.921745 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:23.922178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:23.922931 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:23.923358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:24.060746 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:24.069134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:24.070786 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:24.071952 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-32765dcc-4e56-47b1-b6c7-5849bf098a78 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.162083 Jul 14 11:11:24.072502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 236/481] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:23 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:25.092606 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:25.093295 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:25.102067 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:25.102649 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:25.104426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:25.104865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:25.237457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:25.246132 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:25.247654 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:25.248836 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-63b5d3e3-255d-41b3-9fc9-c67e18b7a730 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.161431 Jul 14 11:11:25.249393 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 246/482] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:25 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:11:26.267544 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:26.268253 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:26.274921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:26.275372 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:26.276194 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:26.276632 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:26.414796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:26.423363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:26.424895 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:26.426651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c6cee6e5-5641-40c4-8095-0758c5ebd2da tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.163099 Jul 14 11:11:26.427207 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 237/483] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:26 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:27.446234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:27.446848 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:27.453292 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:27.453744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:27.454506 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:27.454945 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:27.592998 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:27.601692 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:27.603190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:27.604412 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c9061232-f5b3-4346-9e9f-944b0a2ee42e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.162138 Jul 14 11:11:27.604974 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 247/484] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:27 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:11:28.623647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:28.624233 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:28.630585 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:28.631032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:28.631827 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:28.632272 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:28.765152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:28.773123 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:28.774641 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:28.775820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-755fd88b-cab3-4f58-9da6-4eb28a51ac5b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.156271 Jul 14 11:11:28.776372 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 238/485] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:28 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:29.491289 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a59a68f4-58c1-45dc-855c-7503ae9aef0e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: .version_select at 0x7f579e0c7f70>, body: {"keypair": {"name": "tempest-keypair-1970604832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2s3IyL6UNWZKy2KqgibfjeLmi/9TGV57SP26Dn14mIee5nCpf3c3eYaD9KZCoSzDvudyYNpJuzG3/5Vh9jKOwBgtxxNUWYdjWY7gU/eA2cvW2cQ6OOee+vP3J0Cv+Hsg=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:29.506837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-a59a68f4-58c1-45dc-855c-7503ae9aef0e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for project 7f04452d94114c64b9882cfa66e29479. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:11:29.511587 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-a59a68f4-58c1-45dc-855c-7503ae9aef0e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for user fffbf852ddc9455f8a68f80ad118e4d1 and project 7f04452d94114c64b9882cfa66e29479. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:11:29.535889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a59a68f4-58c1-45dc-855c-7503ae9aef0e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048296 Jul 14 11:11:29.536447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 248/486] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:11:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:29.794463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:29.795729 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:29.802332 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:29.802781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:29.803599 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:29.804297 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:29.942819 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:29.953199 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:29.954737 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:29.956011 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-52c1be0e-4312-41d4-8f70-4191cd424116 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.165601 Jul 14 11:11:29.956689 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 239/487] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:29 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:30.778618 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1455179855", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e745ada-d5b0-42ea-a509-ecc280f4f780"}], "security_groups": [{"name": "tempest-securitygroup--1720932777"}], "key_name": "tempest-keypair-1970604832", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:30.882231 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] validate_networks() for [('9e745ada-d5b0-42ea-a509-ecc280f4f780', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:11:30.976222 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:30.976896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:30.983500 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:30.984172 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:30.985080 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:30.985515 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:31.118367 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:31.126440 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:31.128075 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:31.129241 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-51f0a805-48df-4de0-bd62-d1c8ecd6620f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.157746 Jul 14 11:11:31.129806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 240/488] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:30 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:11:31.272713 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:11:31.273132 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:11:31.273601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:11:31.274041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:11:31.274449 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:11:31.283427 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:31.283873 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:31.284696 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:31.285711 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:31.301805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for project 7f04452d94114c64b9882cfa66e29479. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:11:31.305961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for user fffbf852ddc9455f8a68f80ad118e4d1 and project 7f04452d94114c64b9882cfa66e29479. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:11:31.316796 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:11:31.319025 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:11:31.364262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab5442ea-cf20-478f-ae77-239e145c2766 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589923 Jul 14 11:11:31.364904 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 249/489] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:11:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:11:31.375792 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-89894ce0-e71e-45e0-87be-9cc60662a587 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:31.376484 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-89894ce0-e71e-45e0-87be-9cc60662a587 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:31.433817 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-89894ce0-e71e-45e0-87be-9cc60662a587 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:31.441725 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-89894ce0-e71e-45e0-87be-9cc60662a587 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1242 microversion: 2.1 time: 0.070760 Jul 14 11:11:31.442367 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 241/490] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:31 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:11:32.149264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:32.149874 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:32.156666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:32.157116 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:32.157889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:32.158323 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:32.292157 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:32.300381 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:32.302000 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:32.303321 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5be80ba7-fce6-44e9-8e39-43938158a92e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.159477 Jul 14 11:11:32.304395 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 250/491] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:32 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:32.459165 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8979bf76-9ce7-43c1-966f-04e3b055d5ba tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:32.460123 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8979bf76-9ce7-43c1-966f-04e3b055d5ba tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:32.467737 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8979bf76-9ce7-43c1-966f-04e3b055d5ba tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:32.468112 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8979bf76-9ce7-43c1-966f-04e3b055d5ba tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:32.468933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8979bf76-9ce7-43c1-966f-04e3b055d5ba tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:32.469328 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8979bf76-9ce7-43c1-966f-04e3b055d5ba tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:32.552544 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8979bf76-9ce7-43c1-966f-04e3b055d5ba tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:32.560340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8979bf76-9ce7-43c1-966f-04e3b055d5ba tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1300 microversion: 2.1 time: 0.106071 Jul 14 11:11:32.560905 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 242/492] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:32 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:33.323495 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:33.324103 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:33.330662 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:33.331332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:33.332869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:33.333302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:33.499889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:33.506944 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:33.508563 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:33.509821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ba28a063-5a92-46aa-a0e5-4d9e58bb8306 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.190487 Jul 14 11:11:33.510469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 251/493] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:33 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:11:33.578325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5f1518a1-528d-4d12-95f5-14f4b7b242c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:33.579021 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5f1518a1-528d-4d12-95f5-14f4b7b242c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:33.585264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f1518a1-528d-4d12-95f5-14f4b7b242c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:33.585802 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f1518a1-528d-4d12-95f5-14f4b7b242c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:33.586602 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f1518a1-528d-4d12-95f5-14f4b7b242c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:33.587042 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f1518a1-528d-4d12-95f5-14f4b7b242c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:33.797982 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5f1518a1-528d-4d12-95f5-14f4b7b242c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:33.806738 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5f1518a1-528d-4d12-95f5-14f4b7b242c3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.232473 Jul 14 11:11:33.807453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 243/494] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:33 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:33.883419 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-6c0b2e60-6d05-46d6-8acf-8e1a6242bf40 req-376e2a6d-5014-4800-84fe-81a01823ae50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6", "tag": "5680042e-3b46-47b0-b87d-a4af8afdfddd"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:33.892552 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6c0b2e60-6d05-46d6-8acf-8e1a6242bf40 req-376e2a6d-5014-4800-84fe-81a01823ae50 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:33.893637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6c0b2e60-6d05-46d6-8acf-8e1a6242bf40 req-376e2a6d-5014-4800-84fe-81a01823ae50 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:33.906375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-6c0b2e60-6d05-46d6-8acf-8e1a6242bf40 req-376e2a6d-5014-4800-84fe-81a01823ae50 service nova] Creating event network-changed:5680042e-3b46-47b0-b87d-a4af8afdfddd for instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 on hv-cinder-84893 Jul 14 11:11:33.911982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-6c0b2e60-6d05-46d6-8acf-8e1a6242bf40 req-376e2a6d-5014-4800-84fe-81a01823ae50 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032291 Jul 14 11:11:33.912567 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 252/495] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:34.529145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:34.529747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:34.536675 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:34.537127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:34.537904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:34.538342 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:34.670396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:34.679261 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:34.680806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:34.681962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f651f3bd-6459-4956-9436-e00fb4648090 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.156985 Jul 14 11:11:34.682515 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 244/496] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:34 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:34.824748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3b37ef7-00c8-4438-82bc-d26c990d08fb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:34.825440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3b37ef7-00c8-4438-82bc-d26c990d08fb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:34.831648 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3b37ef7-00c8-4438-82bc-d26c990d08fb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:34.832089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3b37ef7-00c8-4438-82bc-d26c990d08fb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:34.832844 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3b37ef7-00c8-4438-82bc-d26c990d08fb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:34.833273 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3b37ef7-00c8-4438-82bc-d26c990d08fb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:34.968041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3b37ef7-00c8-4438-82bc-d26c990d08fb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:34.975990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3b37ef7-00c8-4438-82bc-d26c990d08fb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.155910 Jul 14 11:11:34.976558 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 253/497] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:34 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:35.699971 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:35.700568 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:35.706970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:35.707453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:35.708211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:35.708646 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:35.840785 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:35.848830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:35.850334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:35.851553 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-df314ac3-a167-4a59-97b3-7219eadf1e82 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.155542 Jul 14 11:11:35.852081 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 245/498] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:35 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:35.992770 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-40a2e6be-211b-40f6-8f40-04d973692a7a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:35.993313 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-40a2e6be-211b-40f6-8f40-04d973692a7a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:35.999931 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-40a2e6be-211b-40f6-8f40-04d973692a7a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:36.000378 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-40a2e6be-211b-40f6-8f40-04d973692a7a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:36.001130 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-40a2e6be-211b-40f6-8f40-04d973692a7a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:36.001561 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-40a2e6be-211b-40f6-8f40-04d973692a7a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:36.134277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-40a2e6be-211b-40f6-8f40-04d973692a7a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:36.141824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-40a2e6be-211b-40f6-8f40-04d973692a7a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.152923 Jul 14 11:11:36.142386 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 254/499] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:35 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:36.870001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:36.870614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:36.877289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:36.877741 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:36.878517 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:36.878952 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:37.011016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:37.018813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:37.020333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:37.021527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c32feafe-af88-4ad5-a590-3ac5c5034099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.155566 Jul 14 11:11:37.022108 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 246/500] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:36 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:11:37.158041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d6abb93d-2420-4ce4-a818-adc8f188bd3a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:37.158670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d6abb93d-2420-4ce4-a818-adc8f188bd3a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:37.176005 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6abb93d-2420-4ce4-a818-adc8f188bd3a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:37.176623 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6abb93d-2420-4ce4-a818-adc8f188bd3a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:37.177610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6abb93d-2420-4ce4-a818-adc8f188bd3a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:37.178187 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6abb93d-2420-4ce4-a818-adc8f188bd3a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:37.318651 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d6abb93d-2420-4ce4-a818-adc8f188bd3a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:37.326373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d6abb93d-2420-4ce4-a818-adc8f188bd3a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.172121 Jul 14 11:11:37.326979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 255/501] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:37 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:38.040178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:38.040784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:38.047255 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:38.047739 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:38.048538 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:38.048977 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:38.177640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:38.185732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:38.187267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:38.188503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f5c0f0ed-d5e3-455f-b0b9-268c599b16fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1745 microversion: 2.20 time: 0.152289 Jul 14 11:11:38.189078 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 247/502] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:38 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:38.343832 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b057b854-6bd2-4f5d-9feb-98cc72a308bf tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:38.344353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b057b854-6bd2-4f5d-9feb-98cc72a308bf tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:38.352246 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b057b854-6bd2-4f5d-9feb-98cc72a308bf tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:38.352770 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b057b854-6bd2-4f5d-9feb-98cc72a308bf tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:38.353561 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b057b854-6bd2-4f5d-9feb-98cc72a308bf tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:38.354023 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b057b854-6bd2-4f5d-9feb-98cc72a308bf tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:38.497372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b057b854-6bd2-4f5d-9feb-98cc72a308bf tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:38.505208 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b057b854-6bd2-4f5d-9feb-98cc72a308bf tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.165607 Jul 14 11:11:38.505789 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 256/503] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:38 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:38.668507 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-2c09a37e-3efb-433f-bafb-1a7561a073b1 req-14255057-61e7-4a40-829d-ca2bf9fa8c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d03bde1-0583-4099-8098-0077a2fc1084", "name": "network-vif-plugged", "status": "completed", "tag": "81b715b1-2ff3-4295-9104-d4e547039e70"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:38.677043 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-2c09a37e-3efb-433f-bafb-1a7561a073b1 req-14255057-61e7-4a40-829d-ca2bf9fa8c83 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:38.677488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-2c09a37e-3efb-433f-bafb-1a7561a073b1 req-14255057-61e7-4a40-829d-ca2bf9fa8c83 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:38.689194 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-2c09a37e-3efb-433f-bafb-1a7561a073b1 req-14255057-61e7-4a40-829d-ca2bf9fa8c83 service nova] Creating event network-vif-plugged:81b715b1-2ff3-4295-9104-d4e547039e70 for instance 4d03bde1-0583-4099-8098-0077a2fc1084 on hv-cinder-84893 Jul 14 11:11:38.695178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-2c09a37e-3efb-433f-bafb-1a7561a073b1 req-14255057-61e7-4a40-829d-ca2bf9fa8c83 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030090 Jul 14 11:11:38.695979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 248/504] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:11:39.207985 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:39.208604 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:39.214556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:39.214990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:39.215762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:39.216190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:39.355604 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:39.365582 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:39.367093 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:39.368332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-043c7c6d-b245-4d93-b467-1d82854d2d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1745 microversion: 2.20 time: 0.164872 Jul 14 11:11:39.368899 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 257/505] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:39 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:39.523304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8ce74e87-2997-47f9-8f59-ef2377b3b28c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:39.524043 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8ce74e87-2997-47f9-8f59-ef2377b3b28c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:39.530493 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8ce74e87-2997-47f9-8f59-ef2377b3b28c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:39.530940 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8ce74e87-2997-47f9-8f59-ef2377b3b28c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:39.531748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8ce74e87-2997-47f9-8f59-ef2377b3b28c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:39.532190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8ce74e87-2997-47f9-8f59-ef2377b3b28c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:39.669408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8ce74e87-2997-47f9-8f59-ef2377b3b28c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:39.677678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8ce74e87-2997-47f9-8f59-ef2377b3b28c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.159096 Jul 14 11:11:39.678246 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 249/506] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:39 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:40.386098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:40.386756 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:40.393132 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:40.393581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:40.394850 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:40.395284 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:40.532028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:40.540197 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:40.541699 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:40.542849 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-254a25c3-af2c-4a36-bc10-f45381403466 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1745 microversion: 2.20 time: 0.160728 Jul 14 11:11:40.543438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 258/507] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:40 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:40.695982 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-15a98ec8-edab-4ea7-b09d-e643c7e5751d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:40.696572 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-15a98ec8-edab-4ea7-b09d-e643c7e5751d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:40.702698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15a98ec8-edab-4ea7-b09d-e643c7e5751d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:40.703153 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15a98ec8-edab-4ea7-b09d-e643c7e5751d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:40.703965 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15a98ec8-edab-4ea7-b09d-e643c7e5751d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:40.704404 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15a98ec8-edab-4ea7-b09d-e643c7e5751d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:40.722763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:40.837645 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-15a98ec8-edab-4ea7-b09d-e643c7e5751d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:40.845083 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-15a98ec8-edab-4ea7-b09d-e643c7e5751d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.153516 Jul 14 11:11:40.845638 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 250/508] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:40 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:41.142125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a444737b-88da-49b3-9701-b625c4066f90 req-8677e00d-0b7d-447c-896f-f96388ae47db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6", "name": "network-vif-plugged", "status": "completed", "tag": "5680042e-3b46-47b0-b87d-a4af8afdfddd"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:41.150784 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a444737b-88da-49b3-9701-b625c4066f90 req-8677e00d-0b7d-447c-896f-f96388ae47db service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:41.151305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a444737b-88da-49b3-9701-b625c4066f90 req-8677e00d-0b7d-447c-896f-f96388ae47db service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:41.164634 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a444737b-88da-49b3-9701-b625c4066f90 req-8677e00d-0b7d-447c-896f-f96388ae47db service nova] Creating event network-vif-plugged:5680042e-3b46-47b0-b87d-a4af8afdfddd for instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 on hv-cinder-84893 Jul 14 11:11:41.170288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a444737b-88da-49b3-9701-b625c4066f90 req-8677e00d-0b7d-447c-896f-f96388ae47db service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032042 Jul 14 11:11:41.171291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 259/509] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:41.561282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:41.561883 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:41.563832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:41.569742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:41.570213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:41.570970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:41.571410 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:41.700899 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:41.708947 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:41.710454 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:41.711635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6b0d8d5f-f983-45c8-8ecc-20fa7498d21d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1745 microversion: 2.20 time: 0.154414 Jul 14 11:11:41.712190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 251/510] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:41 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:41.863131 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13194ee2-9ea5-412b-9175-341b96bf907c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:41.863866 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-13194ee2-9ea5-412b-9175-341b96bf907c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:41.865815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:41.866655 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=10 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:41.872882 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13194ee2-9ea5-412b-9175-341b96bf907c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:41.873331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13194ee2-9ea5-412b-9175-341b96bf907c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:41.874100 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13194ee2-9ea5-412b-9175-341b96bf907c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:41.874535 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13194ee2-9ea5-412b-9175-341b96bf907c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:42.008333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-13194ee2-9ea5-412b-9175-341b96bf907c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:42.015684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-13194ee2-9ea5-412b-9175-341b96bf907c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.157310 Jul 14 11:11:42.016250 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 260/511] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:41 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:42.729744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:42.730340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:42.736886 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:42.737336 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:42.738100 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:42.738528 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:42.871652 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:42.879645 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:42.881159 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:42.882310 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-791ebbc7-8e9d-464b-b882-6a094885c938 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1745 microversion: 2.20 time: 0.156506 Jul 14 11:11:42.882867 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 252/512] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:42 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:43.032505 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7d30a879-9180-4465-9cfd-8432e5b37bb5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:43.033109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7d30a879-9180-4465-9cfd-8432e5b37bb5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:43.040237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d30a879-9180-4465-9cfd-8432e5b37bb5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:43.040691 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d30a879-9180-4465-9cfd-8432e5b37bb5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:43.041457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d30a879-9180-4465-9cfd-8432e5b37bb5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:43.041892 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d30a879-9180-4465-9cfd-8432e5b37bb5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:43.060593 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:43.173530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7d30a879-9180-4465-9cfd-8432e5b37bb5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:43.181163 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7d30a879-9180-4465-9cfd-8432e5b37bb5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1368 microversion: 2.1 time: 0.152534 Jul 14 11:11:43.181718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 261/513] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:43 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:11:43.900434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:43.901094 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:43.907635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:43.908089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:43.908856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:43.909292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:44.043000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:44.051435 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:44.052908 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:44.054307 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1012c3e2-ae4c-4d96-a498-ebc875ddf185 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1745 microversion: 2.20 time: 0.157772 Jul 14 11:11:44.054863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 253/514] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:43 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:44.197416 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3f2b56a-18ec-4d95-b653-0ca4e2dafcb4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:44.197960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3f2b56a-18ec-4d95-b653-0ca4e2dafcb4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:44.204942 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3f2b56a-18ec-4d95-b653-0ca4e2dafcb4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:44.205398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3f2b56a-18ec-4d95-b653-0ca4e2dafcb4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:44.206172 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3f2b56a-18ec-4d95-b653-0ca4e2dafcb4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:44.206607 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3f2b56a-18ec-4d95-b653-0ca4e2dafcb4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:44.345764 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3f2b56a-18ec-4d95-b653-0ca4e2dafcb4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:44.354869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3f2b56a-18ec-4d95-b653-0ca4e2dafcb4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1558 microversion: 2.1 time: 0.161252 Jul 14 11:11:44.355478 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 262/515] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:44 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:44.372199 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-91db2f0d-ca9f-42e7-aea4-3561f2abfff5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:44.372677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-91db2f0d-ca9f-42e7-aea4-3561f2abfff5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:44.380387 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-91db2f0d-ca9f-42e7-aea4-3561f2abfff5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:44.380745 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-91db2f0d-ca9f-42e7-aea4-3561f2abfff5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:44.381575 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-91db2f0d-ca9f-42e7-aea4-3561f2abfff5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:44.381932 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-91db2f0d-ca9f-42e7-aea4-3561f2abfff5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:44.461996 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-91db2f0d-ca9f-42e7-aea4-3561f2abfff5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093622 Jul 14 11:11:44.462741 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 254/516] 10.222.0.75 () {58 vars in 1274 bytes} [Thu Jul 14 11:11:44 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:45.074595 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:45.075839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:45.084535 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:45.085365 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:45.086438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:45.087272 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:45.276667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:45.286815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:45.288971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:45.290363 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c823eb39-d7a5-42fc-a3f1-bb13133ca295 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.221646 Jul 14 11:11:45.293134 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 263/517] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:45 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:45.899300 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-fe821180-2aa7-46e8-95e2-b9471cedac5e req-2d404729-5a8a-4983-899b-8601d5ea5119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6", "tag": "5680042e-3b46-47b0-b87d-a4af8afdfddd"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:45.924118 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-fe821180-2aa7-46e8-95e2-b9471cedac5e req-2d404729-5a8a-4983-899b-8601d5ea5119 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:45.926299 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-fe821180-2aa7-46e8-95e2-b9471cedac5e req-2d404729-5a8a-4983-899b-8601d5ea5119 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:45.942627 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-fe821180-2aa7-46e8-95e2-b9471cedac5e req-2d404729-5a8a-4983-899b-8601d5ea5119 service nova] Creating event network-changed:5680042e-3b46-47b0-b87d-a4af8afdfddd for instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 on hv-cinder-84893 Jul 14 11:11:45.953526 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-fe821180-2aa7-46e8-95e2-b9471cedac5e req-2d404729-5a8a-4983-899b-8601d5ea5119 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058512 Jul 14 11:11:45.954711 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 255/518] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:46.312445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:46.313127 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:46.328444 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:46.329289 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:46.330328 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:46.330996 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:46.580970 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:46.591466 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:46.601366 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:46.602616 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2b0958e-ffda-41b4-8895-d2c9957e2d65 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.296122 Jul 14 11:11:46.603195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 264/519] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:46 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:47.624717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:47.625403 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:47.632063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:47.632790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:47.633586 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:47.634021 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:47.783072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:47.794429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:47.795992 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:47.797305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-96ad7d87-9557-414d-be9c-0740b1bf57fe tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.178997 Jul 14 11:11:47.803413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 256/520] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:47 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:48.816465 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:48.817052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:48.823890 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:48.824339 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:48.825109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:48.825546 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:48.983405 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:48.992114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:48.994036 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:48.995483 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-273333f9-4ab2-47dd-9848-8c500c638e28 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.183482 Jul 14 11:11:49.006579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 265/521] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:48 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:50.017566 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:50.019416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:50.027912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:50.028504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:50.029709 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:50.030434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:50.224233 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:50.240233 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:50.242910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:50.244751 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7eb7449f-0b90-4b2b-902c-47f8b9326d22 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.234015 Jul 14 11:11:50.246041 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 257/522] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:50 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:11:51.264824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:51.266659 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:51.269615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:51.275552 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:51.276394 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:51.277294 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:51.277768 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:51.467233 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:51.477575 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:51.479083 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:51.480269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b165cd00-0fc7-4859-9eec-c7eda261460e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.219897 Jul 14 11:11:51.480824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 266/523] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:51 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:52.498326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:52.498892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:52.501666 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=51 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:52.507663 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:52.508117 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:52.508961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:52.509545 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:52.657969 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:52.667439 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:52.668845 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:52.670020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ffa1b494-ac6a-435d-ac23-59ccd2224a60 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.175734 Jul 14 11:11:52.670578 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 258/524] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:52 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:53.693634 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:53.694551 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:53.704751 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:53.705309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:53.706136 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:53.706574 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:53.859597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:53.868919 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:53.870554 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:53.871865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e3b26b8-dbc1-4c34-84a8-9a039432fcbf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.187417 Jul 14 11:11:53.875195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 267/525] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:53 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:54.895525 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:54.896117 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:54.902670 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:54.903124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:54.903915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:54.904354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:55.058057 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:55.066528 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:55.068092 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:55.069310 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-be848e9b-7c27-404b-a293-33b388f5dbca tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1740 microversion: 2.20 time: 0.177900 Jul 14 11:11:55.069882 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 259/526] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:54 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:56.087828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:56.088436 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:56.095768 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:56.096218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:56.097625 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:56.098018 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:56.226796 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:56.235072 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:56.236629 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:56.237811 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-13d0fbfd-365d-4048-981f-3ff641de3f34 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1722 microversion: 2.20 time: 0.153888 Jul 14 11:11:56.238369 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 268/527] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:56 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:56.619978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-216c625e-e88e-4ab6-a9ac-cdde172e4fb2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:56.620542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-216c625e-e88e-4ab6-a9ac-cdde172e4fb2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:56.627027 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-216c625e-e88e-4ab6-a9ac-cdde172e4fb2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:56.627569 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-216c625e-e88e-4ab6-a9ac-cdde172e4fb2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:56.628894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-216c625e-e88e-4ab6-a9ac-cdde172e4fb2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:56.629334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-216c625e-e88e-4ab6-a9ac-cdde172e4fb2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:56.652731 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-216c625e-e88e-4ab6-a9ac-cdde172e4fb2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/ips" status: 200 len: 143 microversion: 2.1 time: 0.036619 Jul 14 11:11:56.653304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 260/528] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:11:56 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/ips => generated 143 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:57.256257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:57.256869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:57.263496 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:57.263950 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:57.264719 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:57.265156 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:57.400905 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:57.409765 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:57.411278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:57.412469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-85a26a0c-1c0b-4d88-aa52-f3b553325f38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1722 microversion: 2.20 time: 0.160156 Jul 14 11:11:57.413027 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 269/529] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:57 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:58.430868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:58.431498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:58.438020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:58.438451 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:58.439213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:58.439674 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:58.583263 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:58.591640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:58.593130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:58.594269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8855197a-fa0d-4b88-b625-a2352efbd665 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1725 microversion: 2.20 time: 0.167607 Jul 14 11:11:58.594822 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 261/530] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:58 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:58.612869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d41459aa-be47-413d-a0f5-b4646009a929 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4169c2de-0281-414e-837e-fe0105db6b9a"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:58.613925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d41459aa-be47-413d-a0f5-b4646009a929 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:58.620397 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d41459aa-be47-413d-a0f5-b4646009a929 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:58.620847 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d41459aa-be47-413d-a0f5-b4646009a929 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:58.621612 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d41459aa-be47-413d-a0f5-b4646009a929 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:58.622047 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d41459aa-be47-413d-a0f5-b4646009a929 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:58.837692 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9a250531-fd6c-4835-90b4-be069c5bd203 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27b49c94-6551-4410-bc57-6a048603313c"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:58.838733 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9a250531-fd6c-4835-90b4-be069c5bd203 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:58.844774 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a250531-fd6c-4835-90b4-be069c5bd203 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:58.845218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a250531-fd6c-4835-90b4-be069c5bd203 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:58.845978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a250531-fd6c-4835-90b4-be069c5bd203 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:58.846943 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a250531-fd6c-4835-90b4-be069c5bd203 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:58.909798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d41459aa-be47-413d-a0f5-b4646009a929 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300795 Jul 14 11:11:58.910415 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 270/531] 10.222.0.75 () {62 vars in 1363 bytes} [Thu Jul 14 11:11:58 2022] POST /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:11:59.027749 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3e628319-4042-41ae-a252-5b961ef4aca9 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:59.028406 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3e628319-4042-41ae-a252-5b961ef4aca9 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:59.036379 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e628319-4042-41ae-a252-5b961ef4aca9 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:59.036919 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e628319-4042-41ae-a252-5b961ef4aca9 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:59.038172 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e628319-4042-41ae-a252-5b961ef4aca9 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:59.038276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e628319-4042-41ae-a252-5b961ef4aca9 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:59.138317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3e628319-4042-41ae-a252-5b961ef4aca9 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/action" status: 202 len: 0 microversion: 2.20 time: 0.113742 Jul 14 11:11:59.138493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 271/532] 10.222.0.75 () {62 vars in 1318 bytes} [Thu Jul 14 11:11:59 2022] POST /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:11:59.148822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:59.149431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:59.156831 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:59.157287 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:59.160176 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:59.160637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:59.164603 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9a250531-fd6c-4835-90b4-be069c5bd203 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330014 Jul 14 11:11:59.170931 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 262/533] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:11:58 2022] POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:11:59.177741 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-5f574c6c-e94f-4707-ba60-44fe294ac848 req-6c8d831e-d545-483b-9cea-251c79857713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d03bde1-0583-4099-8098-0077a2fc1084", "name": "network-vif-unplugged", "status": "completed", "tag": "81b715b1-2ff3-4295-9104-d4e547039e70"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:59.199745 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5f574c6c-e94f-4707-ba60-44fe294ac848 req-6c8d831e-d545-483b-9cea-251c79857713 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:59.200365 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5f574c6c-e94f-4707-ba60-44fe294ac848 req-6c8d831e-d545-483b-9cea-251c79857713 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:59.228779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.compute.server_external_events [req-5f574c6c-e94f-4707-ba60-44fe294ac848 req-6c8d831e-d545-483b-9cea-251c79857713 service nova] Unable to find a host for instance 4d03bde1-0583-4099-8098-0077a2fc1084. Dropping event network-vif-unplugged {{(pid=117888) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 11:11:59.229880 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-5f574c6c-e94f-4707-ba60-44fe294ac848 req-6c8d831e-d545-483b-9cea-251c79857713 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057545 Jul 14 11:11:59.230769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 263/534] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 11:11:59.356735 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:59.366684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:59.368240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:59.369629 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-282f657c-c125-475a-b690-abc6ad3377e7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1751 microversion: 2.20 time: 0.226269 Jul 14 11:11:59.370186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 272/535] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:11:59 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:00.389229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:00.389961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:00.396547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:00.396997 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:00.397760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:00.398196 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:00.539719 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:00.549784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:00.551323 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:00.552613 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f5b9668b-a466-47a2-8360-6c97eafe3851 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1753 microversion: 2.20 time: 0.167312 Jul 14 11:12:00.553200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 264/536] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:00 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:01.572329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:01.572902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:01.579710 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:01.580153 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:01.581580 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:01.582006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:01.710509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:01.719210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:01.720868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:01.722065 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33bbba9a-a73b-42ce-8f15-315b89714d25 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1753 microversion: 2.20 time: 0.153797 Jul 14 11:12:01.722657 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 273/537] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:01 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:02.739812 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:02.740415 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:02.747133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:02.747762 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:02.749073 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:02.749652 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:02.902004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:02.911312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:02.912837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:02.914026 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c3b772fb-a47e-49b9-aec6-e310f400ce50 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1753 microversion: 2.20 time: 0.178273 Jul 14 11:12:02.914585 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 265/538] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:02 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:03.932977 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:03.933580 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:03.940943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:03.941534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:03.942426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:03.942954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:03.962733 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:04.083598 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:04.094127 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:04.095666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:04.097380 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3dee39b6-2185-4d03-aeb7-d4c45a9728cb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1753 microversion: 2.20 time: 0.168677 Jul 14 11:12:04.097948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 274/539] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:03 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:05.115474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:05.116115 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:05.122901 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:05.123352 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:05.124152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:05.124587 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:05.262784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:05.272311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:05.273829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:05.274997 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a6f104d7-b6b4-4ecc-9d62-add1f7afc662 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1753 microversion: 2.20 time: 0.163547 Jul 14 11:12:05.275590 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 266/540] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:05 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:06.293862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:06.294481 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:06.301657 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:06.302160 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:06.303004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:06.303473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:06.449392 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:06.458493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:06.460114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:06.461307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0c5ad6c5-291e-487a-879c-0dfcd4497e38 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1753 microversion: 2.20 time: 0.171590 Jul 14 11:12:06.461861 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 275/541] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:06 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:06.728118 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-910f140f-0209-4868-be8b-2bbf80965a5a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:12:06.734750 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-910f140f-0209-4868-be8b-2bbf80965a5a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:06.735201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-910f140f-0209-4868-be8b-2bbf80965a5a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:06.794046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-910f140f-0209-4868-be8b-2bbf80965a5a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Going to try to stop instance {{(pid=117888) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 11:12:06.798513 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:06.840566 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-910f140f-0209-4868-be8b-2bbf80965a5a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/action" status: 202 len: 0 microversion: 2.1 time: 0.116154 Jul 14 11:12:06.841175 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 267/542] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:12:06 2022] POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:12:06.850001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dd3fa161-62bf-456c-b410-99b88f4d597d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:06.850596 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dd3fa161-62bf-456c-b410-99b88f4d597d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:06.856801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd3fa161-62bf-456c-b410-99b88f4d597d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:06.857244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd3fa161-62bf-456c-b410-99b88f4d597d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:06.858022 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd3fa161-62bf-456c-b410-99b88f4d597d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:06.858446 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd3fa161-62bf-456c-b410-99b88f4d597d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:06.994984 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dd3fa161-62bf-456c-b410-99b88f4d597d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:07.004458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dd3fa161-62bf-456c-b410-99b88f4d597d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.158440 Jul 14 11:12:07.005370 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 276/543] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:06 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:07.480643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:07.481324 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:07.489842 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:07.490215 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:07.490977 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:07.491430 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:07.636376 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:07.645245 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:07.646740 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:07.647929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-443765a2-1661-48a8-b187-2c647ca2c454 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.171534 Jul 14 11:12:07.648485 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 268/544] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:07 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:08.022523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-86d63eb7-46ff-4953-820d-dba1696b6476 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:08.023151 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-86d63eb7-46ff-4953-820d-dba1696b6476 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:08.029931 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-86d63eb7-46ff-4953-820d-dba1696b6476 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:08.030370 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-86d63eb7-46ff-4953-820d-dba1696b6476 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:08.031158 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-86d63eb7-46ff-4953-820d-dba1696b6476 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:08.031630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-86d63eb7-46ff-4953-820d-dba1696b6476 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:08.168868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-86d63eb7-46ff-4953-820d-dba1696b6476 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:08.177292 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-86d63eb7-46ff-4953-820d-dba1696b6476 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.159102 Jul 14 11:12:08.177883 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 277/545] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:08 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:08.665888 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:08.666597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:08.673488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:08.674033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:08.675207 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:08.675758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:08.814173 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:08.824800 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:08.826312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:08.827773 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5a923db1-f560-45a9-b2ae-796123c1505e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.165748 Jul 14 11:12:08.828373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 269/546] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:08 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:09.195749 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b67f7a72-5153-49b3-a6d7-5f5a1135f45a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:09.196166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b67f7a72-5153-49b3-a6d7-5f5a1135f45a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:09.206311 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b67f7a72-5153-49b3-a6d7-5f5a1135f45a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:09.206894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b67f7a72-5153-49b3-a6d7-5f5a1135f45a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:09.208203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b67f7a72-5153-49b3-a6d7-5f5a1135f45a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:09.208701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b67f7a72-5153-49b3-a6d7-5f5a1135f45a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:09.347963 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b67f7a72-5153-49b3-a6d7-5f5a1135f45a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:09.356447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b67f7a72-5153-49b3-a6d7-5f5a1135f45a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.165315 Jul 14 11:12:09.357267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 278/547] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:09 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:09.846475 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:09.847125 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:09.854029 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:09.854480 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:09.855262 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:09.855723 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:09.994237 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:10.003481 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:10.004995 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:10.006173 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8a1cad45-3b56-4ec3-801d-4b7f0b343cad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.163569 Jul 14 11:12:10.006725 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 270/548] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:09 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:10.375332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a136fd18-d941-4d1e-9fbf-b0e89015f6d7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:10.376095 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a136fd18-d941-4d1e-9fbf-b0e89015f6d7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:10.383621 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a136fd18-d941-4d1e-9fbf-b0e89015f6d7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:10.384080 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a136fd18-d941-4d1e-9fbf-b0e89015f6d7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:10.384847 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a136fd18-d941-4d1e-9fbf-b0e89015f6d7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:10.385277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a136fd18-d941-4d1e-9fbf-b0e89015f6d7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:10.533604 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a136fd18-d941-4d1e-9fbf-b0e89015f6d7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:10.543423 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a136fd18-d941-4d1e-9fbf-b0e89015f6d7 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.171847 Jul 14 11:12:10.544006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 279/549] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:10 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:11.026006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:11.026668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:11.033382 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:11.034432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:11.035423 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:11.036060 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:11.234270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:11.243039 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:11.244748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:11.245934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b1b2f8d3-6ed1-4038-bfb8-010fa00e8ebb tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.224283 Jul 14 11:12:11.246498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 271/550] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:11 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:11.562440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b7fba6d-e6f2-4d38-9363-10bfb47caf82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:11.563788 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b7fba6d-e6f2-4d38-9363-10bfb47caf82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:11.571015 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b7fba6d-e6f2-4d38-9363-10bfb47caf82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:11.571489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b7fba6d-e6f2-4d38-9363-10bfb47caf82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:11.572271 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b7fba6d-e6f2-4d38-9363-10bfb47caf82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:11.572731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b7fba6d-e6f2-4d38-9363-10bfb47caf82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:11.729457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b7fba6d-e6f2-4d38-9363-10bfb47caf82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:11.738418 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b7fba6d-e6f2-4d38-9363-10bfb47caf82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.180808 Jul 14 11:12:11.739000 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 280/551] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:11 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:12.265532 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:12.266122 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:12.272754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:12.273187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:12.273942 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:12.274486 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:12.426840 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:12.436020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:12.437527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:12.438685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8a70f31c-1ebb-4902-bc2c-be52ab436bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.177119 Jul 14 11:12:12.439442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 272/552] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:12 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:12.756047 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8e06a547-4844-4182-8b38-f225f85c57a9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:12.756663 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8e06a547-4844-4182-8b38-f225f85c57a9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:12.763214 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8e06a547-4844-4182-8b38-f225f85c57a9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:12.763692 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8e06a547-4844-4182-8b38-f225f85c57a9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:12.764474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8e06a547-4844-4182-8b38-f225f85c57a9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:12.764908 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8e06a547-4844-4182-8b38-f225f85c57a9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:12.903876 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8e06a547-4844-4182-8b38-f225f85c57a9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:12.912222 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8e06a547-4844-4182-8b38-f225f85c57a9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.160519 Jul 14 11:12:12.912798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 281/553] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:12 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:13.458460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:13.459491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:13.472701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:13.473606 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:13.475103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:13.475919 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:13.582299 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-baa03106-d0a9-4453-9a66-fdab909858dc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d96676fd-dad7-49c6-8d93-946261f011b2"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:12:13.583453 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-baa03106-d0a9-4453-9a66-fdab909858dc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:13.590190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-baa03106-d0a9-4453-9a66-fdab909858dc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:13.590642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-baa03106-d0a9-4453-9a66-fdab909858dc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:13.591437 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-baa03106-d0a9-4453-9a66-fdab909858dc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:13.591877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-baa03106-d0a9-4453-9a66-fdab909858dc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:13.670622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:13.680327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:13.681807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:13.683106 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7ee5bbd6-1fed-451b-8c0c-ad01b7da21b5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.229991 Jul 14 11:12:13.684010 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 273/554] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:13 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:13.930379 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c59d4dca-ef84-4208-bc4c-8d2f9f9d184c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:13.931008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c59d4dca-ef84-4208-bc4c-8d2f9f9d184c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:13.937312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c59d4dca-ef84-4208-bc4c-8d2f9f9d184c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:13.937759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c59d4dca-ef84-4208-bc4c-8d2f9f9d184c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:13.938520 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c59d4dca-ef84-4208-bc4c-8d2f9f9d184c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:13.938952 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c59d4dca-ef84-4208-bc4c-8d2f9f9d184c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:14.089175 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c59d4dca-ef84-4208-bc4c-8d2f9f9d184c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:14.098003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c59d4dca-ef84-4208-bc4c-8d2f9f9d184c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.171856 Jul 14 11:12:14.098496 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 274/555] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:13 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:14.704772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:14.705990 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:14.716076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:14.716614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:14.717499 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:14.718142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:14.858126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:14.867161 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:14.868792 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:14.869948 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-02b89fd4-fb82-4c5c-afd7-abc49c094fa7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.169513 Jul 14 11:12:14.870802 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 275/556] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:14 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:15.115772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2927250b-7059-4ab2-ba67-daa5e6c81839 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:15.116486 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2927250b-7059-4ab2-ba67-daa5e6c81839 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:15.122946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2927250b-7059-4ab2-ba67-daa5e6c81839 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:15.123539 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2927250b-7059-4ab2-ba67-daa5e6c81839 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:15.124413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2927250b-7059-4ab2-ba67-daa5e6c81839 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:15.124958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2927250b-7059-4ab2-ba67-daa5e6c81839 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:15.265974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2927250b-7059-4ab2-ba67-daa5e6c81839 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:15.274746 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2927250b-7059-4ab2-ba67-daa5e6c81839 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.162992 Jul 14 11:12:15.275312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 276/557] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:15 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:15.888183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:15.888937 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:15.895109 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:15.895602 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:15.896367 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:15.896804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:16.039782 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:16.048479 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:16.050561 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:16.051756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f624ee4e-695a-4386-a158-de6cb932b4d4 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.167570 Jul 14 11:12:16.052537 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 277/558] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:15 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:16.292318 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f6f43b4d-a61c-41d8-aec0-0ae4d6795993 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:16.292918 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f6f43b4d-a61c-41d8-aec0-0ae4d6795993 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:16.299228 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6f43b4d-a61c-41d8-aec0-0ae4d6795993 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:16.299700 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6f43b4d-a61c-41d8-aec0-0ae4d6795993 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:16.300462 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6f43b4d-a61c-41d8-aec0-0ae4d6795993 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:16.300894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6f43b4d-a61c-41d8-aec0-0ae4d6795993 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:16.442416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f6f43b4d-a61c-41d8-aec0-0ae4d6795993 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:16.451237 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f6f43b4d-a61c-41d8-aec0-0ae4d6795993 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.162861 Jul 14 11:12:16.451787 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 278/559] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:16 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:17.070978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:17.071739 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:17.078432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:17.078899 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:17.080860 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:17.080860 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:17.245643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:17.254497 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:17.256060 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:17.257279 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fe17c3a8-5b3f-40ed-b4f8-6c8dda326b37 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.190235 Jul 14 11:12:17.258467 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 279/560] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:17 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:17.469037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e8ad5c36-cd97-44a1-8252-b787e851d58c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:17.469644 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e8ad5c36-cd97-44a1-8252-b787e851d58c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:17.476357 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e8ad5c36-cd97-44a1-8252-b787e851d58c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:17.476807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e8ad5c36-cd97-44a1-8252-b787e851d58c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:17.477584 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e8ad5c36-cd97-44a1-8252-b787e851d58c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:17.478026 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e8ad5c36-cd97-44a1-8252-b787e851d58c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:17.622248 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e8ad5c36-cd97-44a1-8252-b787e851d58c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:17.630964 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e8ad5c36-cd97-44a1-8252-b787e851d58c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.165747 Jul 14 11:12:17.631820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 280/561] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:17 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:18.275364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:18.276131 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:18.282552 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:18.283000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:18.283796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:18.284231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:18.443983 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:18.455077 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:18.456653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:18.458450 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3bb30b55-d0a6-4ae8-b650-b52320535718 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.186496 Jul 14 11:12:18.465973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 281/562] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:18 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:18.649185 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8777ea71-be7d-4465-850c-cbc884e93f2f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:18.649803 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8777ea71-be7d-4465-850c-cbc884e93f2f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:18.656677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8777ea71-be7d-4465-850c-cbc884e93f2f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:18.657124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8777ea71-be7d-4465-850c-cbc884e93f2f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:18.657903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8777ea71-be7d-4465-850c-cbc884e93f2f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:18.658759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8777ea71-be7d-4465-850c-cbc884e93f2f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:18.802034 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8777ea71-be7d-4465-850c-cbc884e93f2f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:18.818473 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8777ea71-be7d-4465-850c-cbc884e93f2f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.173066 Jul 14 11:12:18.819274 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 282/563] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:18 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:19.481667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:19.482357 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:19.488765 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:19.489208 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:19.489963 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:19.490394 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:19.509419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:19.623459 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:19.632646 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:19.634144 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:19.635290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dffb1204-5dc5-40d5-96ad-cf2b61485c07 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.157562 Jul 14 11:12:19.635869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 283/564] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:19 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:19.836322 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-21d5e5e8-263f-40d5-9f8c-a6fc93f44b1e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:19.836841 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-21d5e5e8-263f-40d5-9f8c-a6fc93f44b1e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:19.843102 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21d5e5e8-263f-40d5-9f8c-a6fc93f44b1e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:19.843592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21d5e5e8-263f-40d5-9f8c-a6fc93f44b1e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:19.844377 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21d5e5e8-263f-40d5-9f8c-a6fc93f44b1e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:19.844807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21d5e5e8-263f-40d5-9f8c-a6fc93f44b1e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:19.982711 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-21d5e5e8-263f-40d5-9f8c-a6fc93f44b1e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:19.991183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-21d5e5e8-263f-40d5-9f8c-a6fc93f44b1e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.158794 Jul 14 11:12:19.991793 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 284/565] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:19 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:20.654075 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:20.654742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:20.661920 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:20.662375 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:20.663158 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:20.663629 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:20.795240 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:20.804119 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:20.805637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:20.807931 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-02941159-a061-48ab-86ce-b2dc72d7b801 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.157826 Jul 14 11:12:20.808957 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 285/566] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:20 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:21.009043 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4a186d6f-804f-4baf-97a4-ca2ee5aa119d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:21.009661 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4a186d6f-804f-4baf-97a4-ca2ee5aa119d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:21.016180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a186d6f-804f-4baf-97a4-ca2ee5aa119d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:21.016632 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a186d6f-804f-4baf-97a4-ca2ee5aa119d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:21.017593 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a186d6f-804f-4baf-97a4-ca2ee5aa119d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:21.018625 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a186d6f-804f-4baf-97a4-ca2ee5aa119d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:21.156988 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4a186d6f-804f-4baf-97a4-ca2ee5aa119d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:21.165066 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4a186d6f-804f-4baf-97a4-ca2ee5aa119d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.159971 Jul 14 11:12:21.165652 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 286/567] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:21 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:21.829189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:21.829862 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:21.836416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:21.836862 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:21.837628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:21.838061 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:21.968720 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:21.978742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:21.980467 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:21.981682 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7770ba73-cec3-45f2-8d66-a88b9fb8e99f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.156471 Jul 14 11:12:21.982267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 287/568] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:21 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:22.187485 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b18061e0-eb92-4935-8a93-1ee19fab1db5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:22.188086 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b18061e0-eb92-4935-8a93-1ee19fab1db5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:22.194399 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b18061e0-eb92-4935-8a93-1ee19fab1db5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:22.194853 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b18061e0-eb92-4935-8a93-1ee19fab1db5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:22.195707 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b18061e0-eb92-4935-8a93-1ee19fab1db5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:22.196063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b18061e0-eb92-4935-8a93-1ee19fab1db5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:22.348258 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b18061e0-eb92-4935-8a93-1ee19fab1db5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:22.356265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b18061e0-eb92-4935-8a93-1ee19fab1db5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1720 microversion: 2.1 time: 0.172621 Jul 14 11:12:22.356837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 288/569] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:22 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:23.002830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:23.003620 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:23.005902 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=62 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:23.012604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:23.013048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:23.013836 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:23.014279 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:23.192216 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:23.202648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:23.204198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:23.205474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7a5c6de4-1e66-44fe-a63b-075ff00d2b83 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.207217 Jul 14 11:12:23.206032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 289/570] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:22 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:23.276032 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-baa03106-d0a9-4453-9a66-fdab909858dc tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.698072 Jul 14 11:12:23.276703 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 282/571] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:12:13 2022] POST /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments => generated 194 bytes in 9700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:12:23.373613 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2e6110b8-2244-41cf-94f3-365a35e09f82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:23.374246 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2e6110b8-2244-41cf-94f3-365a35e09f82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:23.380447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2e6110b8-2244-41cf-94f3-365a35e09f82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:23.380898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2e6110b8-2244-41cf-94f3-365a35e09f82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:23.381668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2e6110b8-2244-41cf-94f3-365a35e09f82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:23.382109 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2e6110b8-2244-41cf-94f3-365a35e09f82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:23.521219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2e6110b8-2244-41cf-94f3-365a35e09f82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:23.529566 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2e6110b8-2244-41cf-94f3-365a35e09f82 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1697 microversion: 2.1 time: 0.159868 Jul 14 11:12:23.530132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 290/572] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:23 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:23.547474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6540690b-3e3d-4b2d-a983-1dac4584791d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:12:23.550079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=36 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:23.556442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6540690b-3e3d-4b2d-a983-1dac4584791d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:23.556898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6540690b-3e3d-4b2d-a983-1dac4584791d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:23.618179 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6540690b-3e3d-4b2d-a983-1dac4584791d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Going to try to start instance {{(pid=117889) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 11:12:23.660469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6540690b-3e3d-4b2d-a983-1dac4584791d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/action" status: 202 len: 0 microversion: 2.1 time: 0.117424 Jul 14 11:12:23.661243 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 283/573] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:12:23 2022] POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:12:23.669590 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eab5f60f-011d-49d9-8941-a1fb311990f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:23.670208 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eab5f60f-011d-49d9-8941-a1fb311990f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:23.676478 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eab5f60f-011d-49d9-8941-a1fb311990f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:23.676933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eab5f60f-011d-49d9-8941-a1fb311990f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:23.677707 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eab5f60f-011d-49d9-8941-a1fb311990f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:23.678142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eab5f60f-011d-49d9-8941-a1fb311990f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:23.810518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-eab5f60f-011d-49d9-8941-a1fb311990f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:23.818609 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eab5f60f-011d-49d9-8941-a1fb311990f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1706 microversion: 2.1 time: 0.153118 Jul 14 11:12:23.819188 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 291/574] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:23 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1706 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:24.225685 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:24.226382 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:24.232774 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:24.233228 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:24.233997 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:24.234432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:24.370890 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:24.386523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:24.386523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:24.386523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-079e07c9-9e66-481f-bc62-f0589f3c95fa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.162102 Jul 14 11:12:24.386843 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 284/575] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:24 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:24.835978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b4d114e8-43a7-4d22-ba51-be281e3181ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:24.836583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b4d114e8-43a7-4d22-ba51-be281e3181ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:24.844209 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b4d114e8-43a7-4d22-ba51-be281e3181ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:24.844653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b4d114e8-43a7-4d22-ba51-be281e3181ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:24.845600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b4d114e8-43a7-4d22-ba51-be281e3181ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:24.846720 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b4d114e8-43a7-4d22-ba51-be281e3181ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:25.117145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b4d114e8-43a7-4d22-ba51-be281e3181ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:25.125355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b4d114e8-43a7-4d22-ba51-be281e3181ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1706 microversion: 2.1 time: 0.293249 Jul 14 11:12:25.125937 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 292/576] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:24 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1706 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:25.261681 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:12:25.261892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:12:25.400946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:25.402187 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:25.409145 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:25.409601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:25.410885 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:25.411335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:25.562040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:25.570955 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:25.572484 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:25.573682 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-575b5b6a-8c1c-4a0a-bb7b-6b7cd153121c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.176569 Jul 14 11:12:25.574310 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 285/577] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:25 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:26.144534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-672ac80f-2465-4451-abaf-60474a0eb04d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:26.145134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-672ac80f-2465-4451-abaf-60474a0eb04d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:26.151700 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-672ac80f-2465-4451-abaf-60474a0eb04d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:26.152150 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-672ac80f-2465-4451-abaf-60474a0eb04d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:26.152914 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-672ac80f-2465-4451-abaf-60474a0eb04d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:26.153343 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-672ac80f-2465-4451-abaf-60474a0eb04d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:26.297990 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-672ac80f-2465-4451-abaf-60474a0eb04d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:26.306412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-672ac80f-2465-4451-abaf-60474a0eb04d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1706 microversion: 2.1 time: 0.166273 Jul 14 11:12:26.306975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 293/578] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:26 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1706 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:26.591960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:26.592553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:26.600392 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:26.601046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:26.601944 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:26.602522 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:26.740773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:26.749807 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:26.751399 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:26.753251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c4a44c9d-a8e1-433d-aa66-20a6a8f9946d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.165114 Jul 14 11:12:26.753820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 286/579] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:26 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:27.324297 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-844efafa-f70c-4d1b-b9ae-a4fef48ef44e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:27.324933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-844efafa-f70c-4d1b-b9ae-a4fef48ef44e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:27.331491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-844efafa-f70c-4d1b-b9ae-a4fef48ef44e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:27.331945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-844efafa-f70c-4d1b-b9ae-a4fef48ef44e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:27.332716 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-844efafa-f70c-4d1b-b9ae-a4fef48ef44e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:27.333146 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-844efafa-f70c-4d1b-b9ae-a4fef48ef44e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:27.469579 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-844efafa-f70c-4d1b-b9ae-a4fef48ef44e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:27.478098 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-844efafa-f70c-4d1b-b9ae-a4fef48ef44e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1710 microversion: 2.1 time: 0.157652 Jul 14 11:12:27.478662 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 294/580] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:27 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:27.772766 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:27.773310 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:27.779801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:27.780237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:27.780990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:27.781423 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:27.910209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:27.918539 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:27.920100 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:27.921248 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-074e016a-843e-40e2-9ae1-304bc01cc099 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.152468 Jul 14 11:12:27.921813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 287/581] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:27 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:28.939921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:28.940521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:28.947054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:28.947547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:28.948319 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:28.948743 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:29.079771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:29.088727 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:29.090224 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:29.091371 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-69691872-9223-412b-9ae1-307091170d29 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.155418 Jul 14 11:12:29.091934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 295/582] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:28 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:30.212126 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:30.212769 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:30.218705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:30.219185 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:30.220521 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:30.221008 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:30.355880 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:30.359321 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:30.365759 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:30.367198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:30.368388 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5dbccb32-5227-484b-b493-de5e7d1e7d9a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.262263 Jul 14 11:12:30.368946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 288/583] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:30 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:12:31.387067 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:31.387702 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:31.394889 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:31.395340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:31.396137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:31.396581 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:31.526547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:31.535566 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:31.537088 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:31.538245 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1cc314af-b841-4340-b750-9948d0d9b91c tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.155083 Jul 14 11:12:31.538810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 296/584] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:31 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:32.558665 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:32.559860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:32.568530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:32.569012 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:32.569795 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:32.570231 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:32.708018 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:32.717356 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:32.718858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:32.720052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-943dd438-f5ae-430c-88d7-23fd33db2bba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.166890 Jul 14 11:12:32.720789 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 289/585] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:32 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:32.901238 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-84dc15f7-4547-466e-b2f0-1387746d87d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:12:32.902224 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-84dc15f7-4547-466e-b2f0-1387746d87d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:32.908727 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-84dc15f7-4547-466e-b2f0-1387746d87d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:32.909173 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-84dc15f7-4547-466e-b2f0-1387746d87d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:32.909920 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-84dc15f7-4547-466e-b2f0-1387746d87d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:32.910346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-84dc15f7-4547-466e-b2f0-1387746d87d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:32.933427 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-84dc15f7-4547-466e-b2f0-1387746d87d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lazy-loading 'flavor' on Instance uuid fe2921e8-d6f6-4bcd-a5bd-a02da1353800 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:12:33.054025 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-84dc15f7-4547-466e-b2f0-1387746d87d8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/action" status: 200 len: 32 microversion: 2.1 time: 0.155945 Jul 14 11:12:33.054638 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 297/586] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:12:32 2022] POST /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:12:33.167286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6cc3b80d-7dcb-4317-a6cc-25c660319749 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:33.168029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6cc3b80d-7dcb-4317-a6cc-25c660319749 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:33.174531 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6cc3b80d-7dcb-4317-a6cc-25c660319749 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:33.174980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6cc3b80d-7dcb-4317-a6cc-25c660319749 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:33.175775 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6cc3b80d-7dcb-4317-a6cc-25c660319749 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:33.176212 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6cc3b80d-7dcb-4317-a6cc-25c660319749 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:33.318911 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6cc3b80d-7dcb-4317-a6cc-25c660319749 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:33.327827 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6cc3b80d-7dcb-4317-a6cc-25c660319749 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.267678 Jul 14 11:12:33.328825 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 290/587] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:33 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:33.738971 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:33.739704 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:33.747281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:33.747770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:33.748537 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:33.749161 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:33.754283 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:33.897163 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:33.905759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:33.907275 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:33.908987 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-afa4ac85-54ef-48fc-9a8c-c31966c1ab44 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.174639 Jul 14 11:12:33.909558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 298/588] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:33 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:34.345221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a09fa829-4880-4cdd-bdc5-c1e483d2a47b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:34.345859 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a09fa829-4880-4cdd-bdc5-c1e483d2a47b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:34.352479 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a09fa829-4880-4cdd-bdc5-c1e483d2a47b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:34.352936 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a09fa829-4880-4cdd-bdc5-c1e483d2a47b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:34.353678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a09fa829-4880-4cdd-bdc5-c1e483d2a47b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:34.354115 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a09fa829-4880-4cdd-bdc5-c1e483d2a47b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:34.485601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a09fa829-4880-4cdd-bdc5-c1e483d2a47b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:34.494089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a09fa829-4880-4cdd-bdc5-c1e483d2a47b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.152687 Jul 14 11:12:34.494657 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 291/589] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:34 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:34.927242 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:34.927892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:34.934678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:34.935131 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:34.935985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:34.936364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:35.067894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:35.076354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:35.077848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:35.079003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ad033a64-1fcd-4acc-89ec-3ce7fcf2b56a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.155668 Jul 14 11:12:35.079591 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 299/590] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:34 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:35.397638 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-c934e906-5fa6-4827-ba47-4531e23c5bfc req-c7377c44-62d2-4c16-8104-193714c57cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d03bde1-0583-4099-8098-0077a2fc1084", "name": "network-vif-plugged", "status": "completed", "tag": "81b715b1-2ff3-4295-9104-d4e547039e70"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:12:35.406684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-c934e906-5fa6-4827-ba47-4531e23c5bfc req-c7377c44-62d2-4c16-8104-193714c57cb7 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:35.407132 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-c934e906-5fa6-4827-ba47-4531e23c5bfc req-c7377c44-62d2-4c16-8104-193714c57cb7 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:35.419103 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-c934e906-5fa6-4827-ba47-4531e23c5bfc req-c7377c44-62d2-4c16-8104-193714c57cb7 service nova] Creating event network-vif-plugged:81b715b1-2ff3-4295-9104-d4e547039e70 for instance 4d03bde1-0583-4099-8098-0077a2fc1084 on hv-cinder-84893 Jul 14 11:12:35.424229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-c934e906-5fa6-4827-ba47-4531e23c5bfc req-c7377c44-62d2-4c16-8104-193714c57cb7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030207 Jul 14 11:12:35.424837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 292/591] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:12:35.511535 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c4fbdfd0-934a-4412-9458-535a09720b28 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:35.512153 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c4fbdfd0-934a-4412-9458-535a09720b28 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:35.518915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4fbdfd0-934a-4412-9458-535a09720b28 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:35.519363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4fbdfd0-934a-4412-9458-535a09720b28 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:35.520157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4fbdfd0-934a-4412-9458-535a09720b28 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:35.520597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4fbdfd0-934a-4412-9458-535a09720b28 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:35.652201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c4fbdfd0-934a-4412-9458-535a09720b28 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:35.660042 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c4fbdfd0-934a-4412-9458-535a09720b28 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.152415 Jul 14 11:12:35.660605 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 300/592] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:35 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:36.098718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:36.099435 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:36.105618 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:36.106065 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:36.106832 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:36.107265 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:36.237019 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:36.245406 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:36.246924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:36.248114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4bc733d9-562f-4a8d-bd47-79610cc7e631 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.154187 Jul 14 11:12:36.248743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 293/593] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:36 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:36.677325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-aee0f955-fad6-4276-9550-75535273d718 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:36.678063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-aee0f955-fad6-4276-9550-75535273d718 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:36.684753 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aee0f955-fad6-4276-9550-75535273d718 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:36.685204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aee0f955-fad6-4276-9550-75535273d718 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:36.685972 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aee0f955-fad6-4276-9550-75535273d718 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:36.686414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aee0f955-fad6-4276-9550-75535273d718 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:36.815004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-aee0f955-fad6-4276-9550-75535273d718 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:36.823018 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-aee0f955-fad6-4276-9550-75535273d718 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.149566 Jul 14 11:12:36.823625 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 301/594] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:36 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:37.266167 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:37.266770 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:37.273282 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:37.273727 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:37.274491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:37.274929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:37.404703 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:37.413018 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:37.414512 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:37.415737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fbfa52ac-0ce3-4f53-ad6b-b0f9164e01d7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.153419 Jul 14 11:12:37.416247 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 294/595] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:37 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:37.841419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d9978a3c-80d6-4183-a3e1-16dd81f834a2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:37.842018 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d9978a3c-80d6-4183-a3e1-16dd81f834a2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:37.849428 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9978a3c-80d6-4183-a3e1-16dd81f834a2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:37.849913 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9978a3c-80d6-4183-a3e1-16dd81f834a2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:37.850687 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9978a3c-80d6-4183-a3e1-16dd81f834a2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:37.851250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9978a3c-80d6-4183-a3e1-16dd81f834a2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:37.990391 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d9978a3c-80d6-4183-a3e1-16dd81f834a2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:37.998619 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d9978a3c-80d6-4183-a3e1-16dd81f834a2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.161309 Jul 14 11:12:37.999190 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 302/596] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:37 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:38.434507 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:38.435126 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:38.442159 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:38.442613 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:38.443504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:38.443945 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:38.584367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:38.593260 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:38.594770 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:38.596637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-07f73257-bf64-479e-ae66-1ca1dfc6983a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1809 microversion: 2.20 time: 0.166088 Jul 14 11:12:38.597205 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 295/597] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:38 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:39.015985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-32bcfcaf-a7c6-4f3f-9615-ef5f636c70cd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:39.016629 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-32bcfcaf-a7c6-4f3f-9615-ef5f636c70cd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:39.023559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32bcfcaf-a7c6-4f3f-9615-ef5f636c70cd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:39.024005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32bcfcaf-a7c6-4f3f-9615-ef5f636c70cd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:39.024763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32bcfcaf-a7c6-4f3f-9615-ef5f636c70cd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:39.025191 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32bcfcaf-a7c6-4f3f-9615-ef5f636c70cd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:39.156619 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-32bcfcaf-a7c6-4f3f-9615-ef5f636c70cd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:39.164572 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-32bcfcaf-a7c6-4f3f-9615-ef5f636c70cd tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.152628 Jul 14 11:12:39.165138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 303/598] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:39 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:39.615186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:39.615827 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:39.622314 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:39.622759 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:39.623561 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:39.623990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:39.754820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:39.763293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:39.764821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:39.765981 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3d1ae167-a2ed-475a-b4de-9a75e40e419b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1796 microversion: 2.20 time: 0.155196 Jul 14 11:12:39.766547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 296/599] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:12:39 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1796 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:12:40.181924 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-06817cb8-bdf5-4b96-81ea-48fcc2b5552a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:40.182674 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-06817cb8-bdf5-4b96-81ea-48fcc2b5552a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:40.189131 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06817cb8-bdf5-4b96-81ea-48fcc2b5552a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:40.189593 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06817cb8-bdf5-4b96-81ea-48fcc2b5552a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:40.190368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06817cb8-bdf5-4b96-81ea-48fcc2b5552a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:40.190809 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06817cb8-bdf5-4b96-81ea-48fcc2b5552a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:40.322278 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-06817cb8-bdf5-4b96-81ea-48fcc2b5552a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:40.330795 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-06817cb8-bdf5-4b96-81ea-48fcc2b5552a tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.153086 Jul 14 11:12:40.331422 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 304/600] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:40 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:41.348242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e98e32fc-7236-4ea8-a498-da72ab58d231 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:41.348847 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e98e32fc-7236-4ea8-a498-da72ab58d231 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:41.355662 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e98e32fc-7236-4ea8-a498-da72ab58d231 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:41.356109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e98e32fc-7236-4ea8-a498-da72ab58d231 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:41.356871 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e98e32fc-7236-4ea8-a498-da72ab58d231 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:41.357299 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e98e32fc-7236-4ea8-a498-da72ab58d231 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:41.486999 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e98e32fc-7236-4ea8-a498-da72ab58d231 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:41.494999 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e98e32fc-7236-4ea8-a498-da72ab58d231 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.150685 Jul 14 11:12:41.495598 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 297/601] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:41 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:42.512590 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f3382947-de13-4a20-a177-d221b4c3a3ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:42.513147 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f3382947-de13-4a20-a177-d221b4c3a3ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:42.519729 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3382947-de13-4a20-a177-d221b4c3a3ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:42.520184 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3382947-de13-4a20-a177-d221b4c3a3ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:42.520956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3382947-de13-4a20-a177-d221b4c3a3ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:42.521397 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3382947-de13-4a20-a177-d221b4c3a3ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:42.655956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f3382947-de13-4a20-a177-d221b4c3a3ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:42.664037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f3382947-de13-4a20-a177-d221b4c3a3ea tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.155405 Jul 14 11:12:42.664596 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 305/602] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:42 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:43.681822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-624b6ee6-cecc-4fb7-a974-c2c159adc026 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:43.682417 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-624b6ee6-cecc-4fb7-a974-c2c159adc026 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:43.688898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-624b6ee6-cecc-4fb7-a974-c2c159adc026 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:43.689341 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-624b6ee6-cecc-4fb7-a974-c2c159adc026 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:43.690090 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-624b6ee6-cecc-4fb7-a974-c2c159adc026 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:43.690520 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-624b6ee6-cecc-4fb7-a974-c2c159adc026 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:43.819215 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-624b6ee6-cecc-4fb7-a974-c2c159adc026 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:43.827857 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-624b6ee6-cecc-4fb7-a974-c2c159adc026 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.149972 Jul 14 11:12:43.828458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 298/603] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:43 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:44.844355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-21e9ce0b-b2ed-4672-ae41-2f23f4b97c52 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:44.844892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-21e9ce0b-b2ed-4672-ae41-2f23f4b97c52 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:44.851747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21e9ce0b-b2ed-4672-ae41-2f23f4b97c52 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:44.852202 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21e9ce0b-b2ed-4672-ae41-2f23f4b97c52 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:44.852968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21e9ce0b-b2ed-4672-ae41-2f23f4b97c52 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:44.853409 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21e9ce0b-b2ed-4672-ae41-2f23f4b97c52 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:44.982605 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-21e9ce0b-b2ed-4672-ae41-2f23f4b97c52 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:44.991163 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-21e9ce0b-b2ed-4672-ae41-2f23f4b97c52 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.150710 Jul 14 11:12:44.991777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 306/604] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:44 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:46.008343 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-925b61d7-1357-446e-a386-3666c584d9a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:46.008949 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-925b61d7-1357-446e-a386-3666c584d9a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:46.015608 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-925b61d7-1357-446e-a386-3666c584d9a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:46.016063 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-925b61d7-1357-446e-a386-3666c584d9a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:46.016830 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-925b61d7-1357-446e-a386-3666c584d9a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:46.017267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-925b61d7-1357-446e-a386-3666c584d9a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:46.153592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-925b61d7-1357-446e-a386-3666c584d9a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:46.162876 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-925b61d7-1357-446e-a386-3666c584d9a5 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.158333 Jul 14 11:12:46.163479 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 299/605] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:46 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:47.180710 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5c8e124f-128c-4a90-b835-107b4a831ffb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:47.181339 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5c8e124f-128c-4a90-b835-107b4a831ffb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:47.187810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5c8e124f-128c-4a90-b835-107b4a831ffb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:47.188253 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5c8e124f-128c-4a90-b835-107b4a831ffb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:47.189209 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5c8e124f-128c-4a90-b835-107b4a831ffb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:47.189645 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5c8e124f-128c-4a90-b835-107b4a831ffb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:47.320010 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5c8e124f-128c-4a90-b835-107b4a831ffb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:47.328246 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5c8e124f-128c-4a90-b835-107b4a831ffb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1730 microversion: 2.1 time: 0.151723 Jul 14 11:12:47.328823 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 307/606] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:47 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:48.345355 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c965edfd-b66f-4272-807e-920bca46fa29 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:48.345960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c965edfd-b66f-4272-807e-920bca46fa29 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:48.352649 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c965edfd-b66f-4272-807e-920bca46fa29 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:48.353109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c965edfd-b66f-4272-807e-920bca46fa29 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:48.353872 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c965edfd-b66f-4272-807e-920bca46fa29 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:48.354301 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c965edfd-b66f-4272-807e-920bca46fa29 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:48.496720 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c965edfd-b66f-4272-807e-920bca46fa29 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:48.505636 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c965edfd-b66f-4272-807e-920bca46fa29 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1710 microversion: 2.1 time: 0.164103 Jul 14 11:12:48.506221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 300/607] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:48 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:48.560837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:48.561338 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:48.568700 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:48.569150 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:48.569931 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:48.570373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:48.699307 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] HTTP exception thrown: Cannot 'detach_volume' instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 while it is in vm_state rescued Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Request method failure captured: Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments/d96676fd-dad7-49c6-8d93-946261f011b2 HTTP/1.1 Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_jzy9h1Afs0zs0rg7mjGvgG2X2oacoD26dWlQUtf-FovaBrL9N0VLYZ7co154V9baVMH9pm0O_AMwefnkDNKFUvb3NMjRak-11YX1GGW-wLFw7qg6AZf1dPN_XPxFsfrvSfcSfka3MOyF0cOnn4UTDGmmi3OcXqllY1XqLLVKI1kew Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:12:48.700959 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b3f043134a3d4369983f36769d2ae197", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: cb80e0c64c3348cfac5ad2c4f82fb606 Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:12:48.702504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Cannot 'detach_volume' instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 while it is in vm_state rescued Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'server_id': 'fe2921e8-d6f6-4bcd-a5bd-a02da1353800', 'id': 'd96676fd-dad7-49c6-8d93-946261f011b2'} Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:12:48.703301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 while it is in vm_state rescued Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 while it is in vm_state rescued Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:12:48.704592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Returning 409 to user: Cannot 'detach_volume' instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 while it is in vm_state rescued {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:12:48.705529 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-aaa66899-9abe-43ca-ad7a-78a02caa3ea2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "DELETE /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments/d96676fd-dad7-49c6-8d93-946261f011b2" status: 409 len: 152 microversion: 2.1 time: 0.145785 Jul 14 11:12:48.705529 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 308/608] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:12:48 2022] DELETE /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments/d96676fd-dad7-49c6-8d93-946261f011b2 => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:12:48.711346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6c87ecb7-cb95-4f79-bb26-ce4d477fc7d9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:12:48.711970 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6c87ecb7-cb95-4f79-bb26-ce4d477fc7d9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:48.718041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c87ecb7-cb95-4f79-bb26-ce4d477fc7d9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:48.718482 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c87ecb7-cb95-4f79-bb26-ce4d477fc7d9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:48.719241 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c87ecb7-cb95-4f79-bb26-ce4d477fc7d9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:48.719692 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c87ecb7-cb95-4f79-bb26-ce4d477fc7d9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:48.787703 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6c87ecb7-cb95-4f79-bb26-ce4d477fc7d9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "POST /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/action" status: 202 len: 0 microversion: 2.1 time: 0.079851 Jul 14 11:12:48.788269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 301/609] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:12:48 2022] POST /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:12:48.797060 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a11c139a-7f94-411d-b1a2-1aca466e41cb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:48.799020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a11c139a-7f94-411d-b1a2-1aca466e41cb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:48.805423 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a11c139a-7f94-411d-b1a2-1aca466e41cb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:48.805879 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a11c139a-7f94-411d-b1a2-1aca466e41cb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:48.806746 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a11c139a-7f94-411d-b1a2-1aca466e41cb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:48.807217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a11c139a-7f94-411d-b1a2-1aca466e41cb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:49.024859 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a11c139a-7f94-411d-b1a2-1aca466e41cb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:49.035246 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a11c139a-7f94-411d-b1a2-1aca466e41cb tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1718 microversion: 2.1 time: 0.242266 Jul 14 11:12:49.035871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 309/610] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:48 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1718 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:50.054230 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8c2de238-e729-4b37-ae81-210bee42b45b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:50.054910 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8c2de238-e729-4b37-ae81-210bee42b45b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:50.061125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c2de238-e729-4b37-ae81-210bee42b45b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:50.061570 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c2de238-e729-4b37-ae81-210bee42b45b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:50.062318 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c2de238-e729-4b37-ae81-210bee42b45b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:50.062742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c2de238-e729-4b37-ae81-210bee42b45b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:50.191067 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8c2de238-e729-4b37-ae81-210bee42b45b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:50.199309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8c2de238-e729-4b37-ae81-210bee42b45b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1718 microversion: 2.1 time: 0.149966 Jul 14 11:12:50.199923 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 302/611] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:50 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:51.216550 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-267393fb-3765-4c5f-b4c0-201006f6cc0d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:51.217160 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-267393fb-3765-4c5f-b4c0-201006f6cc0d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:51.224460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-267393fb-3765-4c5f-b4c0-201006f6cc0d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:51.224913 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-267393fb-3765-4c5f-b4c0-201006f6cc0d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:51.225743 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-267393fb-3765-4c5f-b4c0-201006f6cc0d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:51.226248 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-267393fb-3765-4c5f-b4c0-201006f6cc0d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:51.360155 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-267393fb-3765-4c5f-b4c0-201006f6cc0d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:51.368706 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-267393fb-3765-4c5f-b4c0-201006f6cc0d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1718 microversion: 2.1 time: 0.156028 Jul 14 11:12:51.369277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 310/612] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:51 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:12:52.386497 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9135829d-5af6-49d7-a04b-438203bfb6b9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:52.387124 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9135829d-5af6-49d7-a04b-438203bfb6b9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:52.393627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9135829d-5af6-49d7-a04b-438203bfb6b9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:52.394066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9135829d-5af6-49d7-a04b-438203bfb6b9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:52.394819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9135829d-5af6-49d7-a04b-438203bfb6b9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:52.395244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9135829d-5af6-49d7-a04b-438203bfb6b9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:52.736353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9135829d-5af6-49d7-a04b-438203bfb6b9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:12:52.744176 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9135829d-5af6-49d7-a04b-438203bfb6b9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1724 microversion: 2.1 time: 0.362059 Jul 14 11:12:52.744748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 303/613] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:12:52 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:12:52.761036 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2307938c-e8f7-4d5d-afd3-f480b4fbbe67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:12:52.761571 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2307938c-e8f7-4d5d-afd3-f480b4fbbe67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:12:52.768033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2307938c-e8f7-4d5d-afd3-f480b4fbbe67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:52.768483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2307938c-e8f7-4d5d-afd3-f480b4fbbe67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:52.769244 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2307938c-e8f7-4d5d-afd3-f480b4fbbe67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:52.769673 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2307938c-e8f7-4d5d-afd3-f480b4fbbe67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:52.849896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2307938c-e8f7-4d5d-afd3-f480b4fbbe67 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092837 Jul 14 11:12:52.850489 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 311/614] 10.222.0.75 () {58 vars in 1274 bytes} [Thu Jul 14 11:12:52 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:12:53.748920 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-29aa868a-806f-49d4-807a-1504e3c337e0 req-13bff3bb-dcb4-4fa6-bd2f-f6fdca02e7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe2921e8-d6f6-4bcd-a5bd-a02da1353800", "tag": "8f073a5b-cf77-4431-946c-0d8651ac7527"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:12:53.758886 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=42 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:53.760939 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-29aa868a-806f-49d4-807a-1504e3c337e0 req-13bff3bb-dcb4-4fa6-bd2f-f6fdca02e7de service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:53.764735 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-29aa868a-806f-49d4-807a-1504e3c337e0 req-13bff3bb-dcb4-4fa6-bd2f-f6fdca02e7de service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:53.776632 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-29aa868a-806f-49d4-807a-1504e3c337e0 req-13bff3bb-dcb4-4fa6-bd2f-f6fdca02e7de service nova] Creating event network-changed:8f073a5b-cf77-4431-946c-0d8651ac7527 for instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 on hv-cinder-84893 Jul 14 11:12:53.781602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-29aa868a-806f-49d4-807a-1504e3c337e0 req-13bff3bb-dcb4-4fa6-bd2f-f6fdca02e7de service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036430 Jul 14 11:12:53.782198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 304/615] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:12:55.796106 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-96d46491-387a-421e-966f-3f77c9ad49a0 req-0029bf37-cde1-42df-98b1-b2b5d54b722d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe2921e8-d6f6-4bcd-a5bd-a02da1353800", "tag": "8f073a5b-cf77-4431-946c-0d8651ac7527"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:12:55.799532 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=46 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:55.805527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-96d46491-387a-421e-966f-3f77c9ad49a0 req-0029bf37-cde1-42df-98b1-b2b5d54b722d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:12:55.805958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-96d46491-387a-421e-966f-3f77c9ad49a0 req-0029bf37-cde1-42df-98b1-b2b5d54b722d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:12:55.817180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-96d46491-387a-421e-966f-3f77c9ad49a0 req-0029bf37-cde1-42df-98b1-b2b5d54b722d service nova] Creating event network-changed:8f073a5b-cf77-4431-946c-0d8651ac7527 for instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 on hv-cinder-84893 Jul 14 11:12:55.822033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-96d46491-387a-421e-966f-3f77c9ad49a0 req-0029bf37-cde1-42df-98b1-b2b5d54b722d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030123 Jul 14 11:12:55.822611 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 312/616] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:16.113736 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:16.114555 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:16.174074 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7ca6c26c-b450-4702-81f1-acbe813c927f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:16.174643 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7ca6c26c-b450-4702-81f1-acbe813c927f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:16.181075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ca6c26c-b450-4702-81f1-acbe813c927f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:16.181515 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ca6c26c-b450-4702-81f1-acbe813c927f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:16.182261 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ca6c26c-b450-4702-81f1-acbe813c927f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:16.182688 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ca6c26c-b450-4702-81f1-acbe813c927f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:16.207723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7ca6c26c-b450-4702-81f1-acbe813c927f tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6/ips" status: 200 len: 149 microversion: 2.1 time: 0.095517 Jul 14 11:13:16.208287 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 305/617] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:13:16 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:16.217383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:16.218137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=82 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:16.222769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "245b2af1-7f49-40ed-8d3b-b92d03d180e1"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:16.223998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:16.230940 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:16.231418 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:16.232176 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:16.232708 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:16.311289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Invalid volume: volume 245b2af1-7f49-40ed-8d3b-b92d03d180e1 is already attached to instances: 9966b0a3-56f9-486d-99ba-0e616d15167a Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: POST /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6/os-volume_attachments HTTP/1.1 Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 74 Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:13:16.313639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {"volumeAttachment": {"volumeId": "245b2af1-7f49-40ed-8d3b-b92d03d180e1"}} Jul 14 11:13:16.316024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Invalid volume: volume 245b2af1-7f49-40ed-8d3b-b92d03d180e1 is already attached to instances: 9966b0a3-56f9-486d-99ba-0e616d15167a Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'server_id': 'e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6', 'body': {'volumeAttachment': {'volumeId': '245b2af1-7f49-40ed-8d3b-b92d03d180e1'}}} Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 245b2af1-7f49-40ed-8d3b-b92d03d180e1 is already attached to instances: 9966b0a3-56f9-486d-99ba-0e616d15167a Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:16.317383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 245b2af1-7f49-40ed-8d3b-b92d03d180e1 is already attached to instances: 9966b0a3-56f9-486d-99ba-0e616d15167a Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:16.319556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:13:16.321665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:13:16.321665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:13:16.321665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:13:16.321665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 245b2af1-7f49-40ed-8d3b-b92d03d180e1 is already attached to instances: 9966b0a3-56f9-486d-99ba-0e616d15167a Jul 14 11:13:16.321665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:16.321665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 400 to user: Invalid volume: volume 245b2af1-7f49-40ed-8d3b-b92d03d180e1 is already attached to instances: 9966b0a3-56f9-486d-99ba-0e616d15167a {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:13:16.321665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7a1f6a24-add1-48e1-a56e-ca90dda7e0ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099953 Jul 14 11:13:16.321665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 313/618] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:13:16 2022] POST /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:13:16.324551 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0ba288ca-5a62-4fd6-b9d1-dbb6c659e14b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:16.325060 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0ba288ca-5a62-4fd6-b9d1-dbb6c659e14b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:16.331049 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ba288ca-5a62-4fd6-b9d1-dbb6c659e14b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:16.331585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ba288ca-5a62-4fd6-b9d1-dbb6c659e14b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:16.332331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ba288ca-5a62-4fd6-b9d1-dbb6c659e14b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:16.332755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ba288ca-5a62-4fd6-b9d1-dbb6c659e14b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:16.356599 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0ba288ca-5a62-4fd6-b9d1-dbb6c659e14b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:13:16.434184 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0ba288ca-5a62-4fd6-b9d1-dbb6c659e14b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 204 len: 0 microversion: 2.1 time: 0.112997 Jul 14 11:13:16.435198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 306/619] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:13:16 2022] DELETE /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:13:16.445643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-460f1a29-bb03-49de-a371-d21484241f6e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:16.446278 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-460f1a29-bb03-49de-a371-d21484241f6e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:16.453218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-460f1a29-bb03-49de-a371-d21484241f6e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:16.453703 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-460f1a29-bb03-49de-a371-d21484241f6e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:16.454470 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-460f1a29-bb03-49de-a371-d21484241f6e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:16.454906 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-460f1a29-bb03-49de-a371-d21484241f6e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:16.586668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-460f1a29-bb03-49de-a371-d21484241f6e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:16.594392 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-460f1a29-bb03-49de-a371-d21484241f6e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1682 microversion: 2.1 time: 0.152760 Jul 14 11:13:16.594962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 314/620] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:16 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:17.613282 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4912ad25-3f63-4b92-ab69-e872046a4ead tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:17.613907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4912ad25-3f63-4b92-ab69-e872046a4ead tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:17.620322 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4912ad25-3f63-4b92-ab69-e872046a4ead tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:17.620763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4912ad25-3f63-4b92-ab69-e872046a4ead tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:17.621517 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4912ad25-3f63-4b92-ab69-e872046a4ead tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:17.621941 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4912ad25-3f63-4b92-ab69-e872046a4ead tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:17.751576 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4912ad25-3f63-4b92-ab69-e872046a4ead tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:17.759031 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4912ad25-3f63-4b92-ab69-e872046a4ead tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1682 microversion: 2.1 time: 0.150698 Jul 14 11:13:17.759641 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 307/621] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:17 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:18.776806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8a38362b-04b1-4c98-ace9-1086bd19abe2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:18.777446 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8a38362b-04b1-4c98-ace9-1086bd19abe2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:18.784046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a38362b-04b1-4c98-ace9-1086bd19abe2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:18.784515 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a38362b-04b1-4c98-ace9-1086bd19abe2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:18.785291 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a38362b-04b1-4c98-ace9-1086bd19abe2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:18.785731 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8a38362b-04b1-4c98-ace9-1086bd19abe2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:19.280268 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8a38362b-04b1-4c98-ace9-1086bd19abe2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:19.287796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8a38362b-04b1-4c98-ace9-1086bd19abe2 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 200 len: 1682 microversion: 2.1 time: 0.514841 Jul 14 11:13:19.288362 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 315/622] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:18 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 1682 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:19.821039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b73e4263-b720-497b-b6dd-e9d85783abde req-60a9cc2e-f728-4ffe-a3f7-0a0b81745ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6", "name": "network-vif-deleted", "tag": "5680042e-3b46-47b0-b87d-a4af8afdfddd"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:19.831692 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b73e4263-b720-497b-b6dd-e9d85783abde req-60a9cc2e-f728-4ffe-a3f7-0a0b81745ed3 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:19.832479 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b73e4263-b720-497b-b6dd-e9d85783abde req-60a9cc2e-f728-4ffe-a3f7-0a0b81745ed3 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:19.852006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b73e4263-b720-497b-b6dd-e9d85783abde req-60a9cc2e-f728-4ffe-a3f7-0a0b81745ed3 service nova] Creating event network-vif-deleted:5680042e-3b46-47b0-b87d-a4af8afdfddd for instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 on hv-cinder-84893 Jul 14 11:13:19.858846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b73e4263-b720-497b-b6dd-e9d85783abde req-60a9cc2e-f728-4ffe-a3f7-0a0b81745ed3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109170 Jul 14 11:13:19.860933 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 308/623] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:20.314285 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:20.314950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:20.326249 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:20.326966 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:20.329103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:20.329816 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:20.345520 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 HTTP/1.1 Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:13:20.348518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:13:20.350055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6'} Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:13:20.350929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:13:20.352396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:20.354720 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:13:20.355749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-de1ce4b5-090f-40d4-8ef0-a20a8bfd1ad1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 404 len: 111 microversion: 2.1 time: 0.053251 Jul 14 11:13:20.356780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 316/624] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:20 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:13:20.365761 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc6ad050-62da-4b0c-bc7d-5af061396bfa tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '.version_select at 0x7f579e05c550>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:20.388578 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bc6ad050-62da-4b0c-bc7d-5af061396bfa tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970604832" status: 202 len: 0 microversion: 2.1 time: 0.026868 Jul 14 11:13:20.389585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 309/625] 10.222.0.75 () {58 vars in 1220 bytes} [Thu Jul 14 11:13:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970604832 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:13:21.082028 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e3091e69-2007-41b3-a4e3-4416dd9cb306 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:21.082617 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e3091e69-2007-41b3-a4e3-4416dd9cb306 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:21.089203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e3091e69-2007-41b3-a4e3-4416dd9cb306 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:21.089734 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e3091e69-2007-41b3-a4e3-4416dd9cb306 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:21.090582 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e3091e69-2007-41b3-a4e3-4416dd9cb306 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:21.091083 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e3091e69-2007-41b3-a4e3-4416dd9cb306 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:21.178817 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-e3091e69-2007-41b3-a4e3-4416dd9cb306 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lazy-loading 'services' on Instance uuid 9966b0a3-56f9-486d-99ba-0e616d15167a {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:13:21.300838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e3091e69-2007-41b3-a4e3-4416dd9cb306 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-volume_attachments/245b2af1-7f49-40ed-8d3b-b92d03d180e1" status: 202 len: 0 microversion: 2.1 time: 0.222528 Jul 14 11:13:21.301311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 317/626] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:13:21 2022] DELETE /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-volume_attachments/245b2af1-7f49-40ed-8d3b-b92d03d180e1 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:13:21.311967 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e340531d-6edd-42a2-86a3-28d6ee67c9d6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:21.313035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e340531d-6edd-42a2-86a3-28d6ee67c9d6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:21.319846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e340531d-6edd-42a2-86a3-28d6ee67c9d6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:21.320296 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e340531d-6edd-42a2-86a3-28d6ee67c9d6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:21.321265 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e340531d-6edd-42a2-86a3-28d6ee67c9d6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:21.321680 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e340531d-6edd-42a2-86a3-28d6ee67c9d6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:21.354742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e340531d-6edd-42a2-86a3-28d6ee67c9d6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047818 Jul 14 11:13:21.355623 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 310/627] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:13:21 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:22.367849 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-823e1e40-a327-4a36-afe7-00e5385d2a81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:22.368862 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-823e1e40-a327-4a36-afe7-00e5385d2a81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:22.376357 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-823e1e40-a327-4a36-afe7-00e5385d2a81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:22.377064 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-823e1e40-a327-4a36-afe7-00e5385d2a81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:22.378313 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-823e1e40-a327-4a36-afe7-00e5385d2a81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:22.379009 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-823e1e40-a327-4a36-afe7-00e5385d2a81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:22.410936 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-823e1e40-a327-4a36-afe7-00e5385d2a81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047925 Jul 14 11:13:22.411511 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 318/628] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:13:22 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:13:22.469515 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0fe2752e-84c9-45a2-86e2-2fb9d225a658 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:22.470030 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0fe2752e-84c9-45a2-86e2-2fb9d225a658 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:22.476416 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fe2752e-84c9-45a2-86e2-2fb9d225a658 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:22.476869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fe2752e-84c9-45a2-86e2-2fb9d225a658 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:22.477636 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fe2752e-84c9-45a2-86e2-2fb9d225a658 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:22.478102 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fe2752e-84c9-45a2-86e2-2fb9d225a658 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:22.504097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0fe2752e-84c9-45a2-86e2-2fb9d225a658 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:13:22.583823 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0fe2752e-84c9-45a2-86e2-2fb9d225a658 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 204 len: 0 microversion: 2.1 time: 0.118172 Jul 14 11:13:22.584630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 311/629] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:13:22 2022] DELETE /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:13:22.593188 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e53e80f2-5e85-4d48-986d-a2677c9534af tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:22.593798 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e53e80f2-5e85-4d48-986d-a2677c9534af tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:22.599821 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e53e80f2-5e85-4d48-986d-a2677c9534af tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:22.600276 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e53e80f2-5e85-4d48-986d-a2677c9534af tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:22.601078 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e53e80f2-5e85-4d48-986d-a2677c9534af tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:22.601519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e53e80f2-5e85-4d48-986d-a2677c9534af tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:22.740488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e53e80f2-5e85-4d48-986d-a2677c9534af tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:22.748565 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e53e80f2-5e85-4d48-986d-a2677c9534af tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1680 microversion: 2.1 time: 0.159441 Jul 14 11:13:22.749154 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 319/630] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:22 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:23.767181 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c13a3707-00dc-489b-ac33-c13625c8a4e3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:23.767913 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c13a3707-00dc-489b-ac33-c13625c8a4e3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:23.774643 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c13a3707-00dc-489b-ac33-c13625c8a4e3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:23.775117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c13a3707-00dc-489b-ac33-c13625c8a4e3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:23.775916 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c13a3707-00dc-489b-ac33-c13625c8a4e3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:23.776351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c13a3707-00dc-489b-ac33-c13625c8a4e3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:23.905489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c13a3707-00dc-489b-ac33-c13625c8a4e3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:23.914011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c13a3707-00dc-489b-ac33-c13625c8a4e3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1680 microversion: 2.1 time: 0.151537 Jul 14 11:13:23.914586 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 312/631] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:23 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:24.931413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-96cc1d5c-96c1-4148-aa19-690391162af7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:24.932149 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-96cc1d5c-96c1-4148-aa19-690391162af7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:24.938653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96cc1d5c-96c1-4148-aa19-690391162af7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:24.939096 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96cc1d5c-96c1-4148-aa19-690391162af7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:24.939892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96cc1d5c-96c1-4148-aa19-690391162af7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:24.940320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96cc1d5c-96c1-4148-aa19-690391162af7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:25.027591 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-96cc1d5c-96c1-4148-aa19-690391162af7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:25.035869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-96cc1d5c-96c1-4148-aa19-690391162af7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 200 len: 1612 microversion: 2.1 time: 0.108484 Jul 14 11:13:25.036444 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 320/632] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:24 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 1612 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:25.104863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e0070734-bfaa-40b3-9c0c-9f163ae79675 req-9ff9f796-538c-4d6a-aae4-37b1365a03a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9966b0a3-56f9-486d-99ba-0e616d15167a", "name": "network-vif-deleted", "tag": "60ab608d-54a2-43be-9f6e-4c5078b5c6b4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:25.115928 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e0070734-bfaa-40b3-9c0c-9f163ae79675 req-9ff9f796-538c-4d6a-aae4-37b1365a03a6 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:25.116370 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e0070734-bfaa-40b3-9c0c-9f163ae79675 req-9ff9f796-538c-4d6a-aae4-37b1365a03a6 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:25.128246 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e0070734-bfaa-40b3-9c0c-9f163ae79675 req-9ff9f796-538c-4d6a-aae4-37b1365a03a6 service nova] Creating event network-vif-deleted:60ab608d-54a2-43be-9f6e-4c5078b5c6b4 for instance 9966b0a3-56f9-486d-99ba-0e616d15167a on hv-cinder-84893 Jul 14 11:13:25.133243 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e0070734-bfaa-40b3-9c0c-9f163ae79675 req-9ff9f796-538c-4d6a-aae4-37b1365a03a6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032561 Jul 14 11:13:25.134445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 313/633] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:26.054104 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:26.054691 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:26.061234 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:26.061611 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:26.062367 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:26.063359 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:26.077570 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a HTTP/1.1 Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:13:26.080769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:13:26.081934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '9966b0a3-56f9-486d-99ba-0e616d15167a'} Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:13:26.082897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:13:26.088531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:26.089856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:13:26.089856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e37bddc4-7612-401b-8086-e8819fb39af6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 404 len: 111 microversion: 2.1 time: 0.033145 Jul 14 11:13:26.089856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 321/634] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:26 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:13:26.095777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7647cb69-1d5f-4efd-8404-6bace4f69f17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '.version_select at 0x7f579e081820>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:26.115625 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7647cb69-1d5f-4efd-8404-6bace4f69f17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-688231624" status: 202 len: 0 microversion: 2.1 time: 0.024022 Jul 14 11:13:26.116450 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 314/635] 10.222.0.75 () {58 vars in 1217 bytes} [Thu Jul 14 11:13:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-688231624 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:13:26.722281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f1b40225-c724-4a3c-8c85-3a35686d50c4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: .version_select at 0x7f579e02f1f0>, body: {"keypair": {"name": "tempest-keypair-664589474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWy4xzt7Lq6tkPVoxMVOyUpCcM7u/3chCTjYklBEhhnscqbPGBvoqoQgjvcdmVyKjzYJ0xbXYVsw/6MZEbHBUioiFBNVIYYsK0OqhdfHSfjstiLArpmiWVC35k6g6E8Lg=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:26.736617 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-f1b40225-c724-4a3c-8c85-3a35686d50c4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for project 7f04452d94114c64b9882cfa66e29479. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:13:26.740361 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-f1b40225-c724-4a3c-8c85-3a35686d50c4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for user fffbf852ddc9455f8a68f80ad118e4d1 and project 7f04452d94114c64b9882cfa66e29479. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:13:26.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f1b40225-c724-4a3c-8c85-3a35686d50c4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049024 Jul 14 11:13:26.767364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 322/636] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:13:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:28.020474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1453342661", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e745ada-d5b0-42ea-a509-ecc280f4f780"}], "security_groups": [{"name": "tempest-securitygroup--1560283738"}], "key_name": "tempest-keypair-664589474", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:28.127253 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] validate_networks() for [('9e745ada-d5b0-42ea-a509-ecc280f4f780', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:13:28.558448 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:13:28.558904 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:13:28.559373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:13:28.559810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:13:28.560221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:13:28.569566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:28.570014 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:28.570819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:28.571250 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:28.589796 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for project 7f04452d94114c64b9882cfa66e29479. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:13:28.593870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for user fffbf852ddc9455f8a68f80ad118e4d1 and project 7f04452d94114c64b9882cfa66e29479. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:13:28.604873 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:13:28.607245 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:13:28.654017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6d228920-20af-4d22-b002-eb2d2fcb8a17 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.638363 Jul 14 11:13:28.654666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 315/637] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:13:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:13:28.664799 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4aa4dc62-a5c3-4ef0-8988-34d1bfe2e073 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:28.665393 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4aa4dc62-a5c3-4ef0-8988-34d1bfe2e073 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:28.728022 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4aa4dc62-a5c3-4ef0-8988-34d1bfe2e073 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:28.735153 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4aa4dc62-a5c3-4ef0-8988-34d1bfe2e073 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1241 microversion: 2.1 time: 0.074216 Jul 14 11:13:28.735756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 323/638] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:28 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:13:29.754005 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4d687b5f-7695-4065-bcb0-5c28732eba80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:29.754623 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4d687b5f-7695-4065-bcb0-5c28732eba80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:29.761104 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d687b5f-7695-4065-bcb0-5c28732eba80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:29.761545 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d687b5f-7695-4065-bcb0-5c28732eba80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:29.762306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d687b5f-7695-4065-bcb0-5c28732eba80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:29.762737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d687b5f-7695-4065-bcb0-5c28732eba80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:29.832244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4d687b5f-7695-4065-bcb0-5c28732eba80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:29.839890 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4d687b5f-7695-4065-bcb0-5c28732eba80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1293 microversion: 2.1 time: 0.090991 Jul 14 11:13:29.840469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 316/639] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:29 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:30.857305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ed31d388-bd46-44ac-8f43-2c58d2ffb907 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:30.858030 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ed31d388-bd46-44ac-8f43-2c58d2ffb907 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:30.865542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed31d388-bd46-44ac-8f43-2c58d2ffb907 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:30.865986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed31d388-bd46-44ac-8f43-2c58d2ffb907 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:30.866756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed31d388-bd46-44ac-8f43-2c58d2ffb907 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:30.867184 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed31d388-bd46-44ac-8f43-2c58d2ffb907 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:31.106922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ed31d388-bd46-44ac-8f43-2c58d2ffb907 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:31.118368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ed31d388-bd46-44ac-8f43-2c58d2ffb907 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1367 microversion: 2.1 time: 0.264774 Jul 14 11:13:31.119822 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 324/640] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:30 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:31.270112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-afd72032-c1f2-4cb4-bf64-50bb041f21a0 req-9da93b23-66d6-48c4-a2ea-9c62ea7401ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5638369-b1e6-4b47-a77e-1e875bac6038", "tag": "1d18c91d-ab99-42c3-b298-881ad82fb9fa"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:31.288066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-afd72032-c1f2-4cb4-bf64-50bb041f21a0 req-9da93b23-66d6-48c4-a2ea-9c62ea7401ef service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:31.288806 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-afd72032-c1f2-4cb4-bf64-50bb041f21a0 req-9da93b23-66d6-48c4-a2ea-9c62ea7401ef service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:31.301203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-afd72032-c1f2-4cb4-bf64-50bb041f21a0 req-9da93b23-66d6-48c4-a2ea-9c62ea7401ef service nova] Creating event network-changed:1d18c91d-ab99-42c3-b298-881ad82fb9fa for instance d5638369-b1e6-4b47-a77e-1e875bac6038 on hv-cinder-84893 Jul 14 11:13:31.306553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-afd72032-c1f2-4cb4-bf64-50bb041f21a0 req-9da93b23-66d6-48c4-a2ea-9c62ea7401ef service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041789 Jul 14 11:13:31.307585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 317/641] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:32.135517 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-48bf477b-0844-4b6a-847c-8cdc179a85bb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:32.136114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-48bf477b-0844-4b6a-847c-8cdc179a85bb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:32.142732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48bf477b-0844-4b6a-847c-8cdc179a85bb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:32.143184 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48bf477b-0844-4b6a-847c-8cdc179a85bb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:32.143993 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48bf477b-0844-4b6a-847c-8cdc179a85bb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:32.144432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48bf477b-0844-4b6a-847c-8cdc179a85bb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:32.548820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-48bf477b-0844-4b6a-847c-8cdc179a85bb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:32.556623 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-48bf477b-0844-4b6a-847c-8cdc179a85bb tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1367 microversion: 2.1 time: 0.425000 Jul 14 11:13:32.557195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 325/642] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:32 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:33.575266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2d8e16ab-7d4c-4c79-9398-5e194030a5d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:33.575910 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2d8e16ab-7d4c-4c79-9398-5e194030a5d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:33.582834 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d8e16ab-7d4c-4c79-9398-5e194030a5d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:33.583287 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d8e16ab-7d4c-4c79-9398-5e194030a5d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:33.584082 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d8e16ab-7d4c-4c79-9398-5e194030a5d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:33.584514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d8e16ab-7d4c-4c79-9398-5e194030a5d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:33.723594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2d8e16ab-7d4c-4c79-9398-5e194030a5d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:33.731021 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2d8e16ab-7d4c-4c79-9398-5e194030a5d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1367 microversion: 2.1 time: 0.160618 Jul 14 11:13:33.731616 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 318/643] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:33 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:34.370627 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-11475c85-b903-45b4-8fd7-c4ec740b24e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:34.371260 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-11475c85-b903-45b4-8fd7-c4ec740b24e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:34.378524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11475c85-b903-45b4-8fd7-c4ec740b24e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:34.378974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11475c85-b903-45b4-8fd7-c4ec740b24e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:34.379898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11475c85-b903-45b4-8fd7-c4ec740b24e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:34.380251 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11475c85-b903-45b4-8fd7-c4ec740b24e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:34.467375 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-11475c85-b903-45b4-8fd7-c4ec740b24e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lazy-loading 'services' on Instance uuid aa194f91-d8c4-46f8-bbef-593b0e0fb64d {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:13:34.551469 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-11475c85-b903-45b4-8fd7-c4ec740b24e0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/os-volume_attachments/27b49c94-6551-4410-bc57-6a048603313c" status: 202 len: 0 microversion: 2.1 time: 0.184953 Jul 14 11:13:34.555366 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 326/644] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:13:34 2022] DELETE /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/os-volume_attachments/27b49c94-6551-4410-bc57-6a048603313c => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:13:34.753996 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7beb1e57-909b-444a-9120-176a85bdcd80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:34.755251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7beb1e57-909b-444a-9120-176a85bdcd80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:34.761181 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7beb1e57-909b-444a-9120-176a85bdcd80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:34.761631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7beb1e57-909b-444a-9120-176a85bdcd80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:34.762404 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7beb1e57-909b-444a-9120-176a85bdcd80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:34.762837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7beb1e57-909b-444a-9120-176a85bdcd80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:34.893694 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7beb1e57-909b-444a-9120-176a85bdcd80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:34.901200 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7beb1e57-909b-444a-9120-176a85bdcd80 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1367 microversion: 2.1 time: 0.151249 Jul 14 11:13:34.901777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 319/645] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:34 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:35.676010 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d3a7568a-bd42-4920-ae03-9c273c293541 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:35.683221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3a7568a-bd42-4920-ae03-9c273c293541 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:35.683674 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3a7568a-bd42-4920-ae03-9c273c293541 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:35.708575 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d3a7568a-bd42-4920-ae03-9c273c293541 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Going to try to stop instance {{(pid=117888) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 11:13:35.760066 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d3a7568a-bd42-4920-ae03-9c273c293541 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/action" status: 202 len: 0 microversion: 2.1 time: 0.088489 Jul 14 11:13:35.764336 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 327/646] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:13:35 2022] POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:13:35.769811 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70ce16e0-e1cc-45d5-abbf-a33bc1e4446e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:35.770421 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-70ce16e0-e1cc-45d5-abbf-a33bc1e4446e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:35.785731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ce16e0-e1cc-45d5-abbf-a33bc1e4446e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:35.786186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ce16e0-e1cc-45d5-abbf-a33bc1e4446e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:35.786970 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ce16e0-e1cc-45d5-abbf-a33bc1e4446e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:35.787428 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ce16e0-e1cc-45d5-abbf-a33bc1e4446e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:35.919162 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0d132422-2fbc-4b26-8d25-d8e267c59aae tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:35.919910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0d132422-2fbc-4b26-8d25-d8e267c59aae tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:35.926892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d132422-2fbc-4b26-8d25-d8e267c59aae tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:35.927340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d132422-2fbc-4b26-8d25-d8e267c59aae tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:35.928153 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d132422-2fbc-4b26-8d25-d8e267c59aae tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:35.928855 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d132422-2fbc-4b26-8d25-d8e267c59aae tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:35.948299 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-70ce16e0-e1cc-45d5-abbf-a33bc1e4446e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:35.955937 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-70ce16e0-e1cc-45d5-abbf-a33bc1e4446e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.190085 Jul 14 11:13:35.956507 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 320/647] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:35 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:36.061015 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0d132422-2fbc-4b26-8d25-d8e267c59aae tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:36.068764 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0d132422-2fbc-4b26-8d25-d8e267c59aae tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1367 microversion: 2.1 time: 0.154037 Jul 14 11:13:36.069339 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 328/648] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:35 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:13:36.974031 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d150501-b34a-48d7-96a9-c20abfaa06a5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:36.974839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9d150501-b34a-48d7-96a9-c20abfaa06a5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:36.981975 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d150501-b34a-48d7-96a9-c20abfaa06a5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:36.982426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d150501-b34a-48d7-96a9-c20abfaa06a5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:36.983221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d150501-b34a-48d7-96a9-c20abfaa06a5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:36.983675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d150501-b34a-48d7-96a9-c20abfaa06a5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:37.085365 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-45f46bc9-42f2-4b31-821c-6edcc644efb1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:37.086094 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-45f46bc9-42f2-4b31-821c-6edcc644efb1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:37.092753 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45f46bc9-42f2-4b31-821c-6edcc644efb1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:37.093286 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45f46bc9-42f2-4b31-821c-6edcc644efb1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:37.093972 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45f46bc9-42f2-4b31-821c-6edcc644efb1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:37.094413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45f46bc9-42f2-4b31-821c-6edcc644efb1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:37.122953 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d150501-b34a-48d7-96a9-c20abfaa06a5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:37.131341 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d150501-b34a-48d7-96a9-c20abfaa06a5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.161680 Jul 14 11:13:37.132115 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 321/649] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:36 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:37.234807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-45f46bc9-42f2-4b31-821c-6edcc644efb1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:37.245636 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-45f46bc9-42f2-4b31-821c-6edcc644efb1 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1367 microversion: 2.1 time: 0.164006 Jul 14 11:13:37.246384 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 329/650] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:37 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:13:37.735461 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-95473fe7-56ba-4ff8-92cf-ba189dd64fea req-034f9808-1fc4-4c05-b27b-db55b043a7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5638369-b1e6-4b47-a77e-1e875bac6038", "name": "network-vif-plugged", "status": "completed", "tag": "1d18c91d-ab99-42c3-b298-881ad82fb9fa"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:37.743772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-95473fe7-56ba-4ff8-92cf-ba189dd64fea req-034f9808-1fc4-4c05-b27b-db55b043a7e8 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:37.744206 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-95473fe7-56ba-4ff8-92cf-ba189dd64fea req-034f9808-1fc4-4c05-b27b-db55b043a7e8 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:37.755840 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-95473fe7-56ba-4ff8-92cf-ba189dd64fea req-034f9808-1fc4-4c05-b27b-db55b043a7e8 service nova] Creating event network-vif-plugged:1d18c91d-ab99-42c3-b298-881ad82fb9fa for instance d5638369-b1e6-4b47-a77e-1e875bac6038 on hv-cinder-84893 Jul 14 11:13:37.760743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-95473fe7-56ba-4ff8-92cf-ba189dd64fea req-034f9808-1fc4-4c05-b27b-db55b043a7e8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087852 Jul 14 11:13:37.761334 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 322/651] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:38.152600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7d883c5-0a14-46eb-8f96-215950881aad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:38.153437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a7d883c5-0a14-46eb-8f96-215950881aad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:38.159769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7d883c5-0a14-46eb-8f96-215950881aad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:38.160226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7d883c5-0a14-46eb-8f96-215950881aad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:38.160991 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7d883c5-0a14-46eb-8f96-215950881aad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:38.161430 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7d883c5-0a14-46eb-8f96-215950881aad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:38.180299 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:38.264937 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62961b1e-3c0a-444a-851d-f4ba81735a22 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:38.265828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62961b1e-3c0a-444a-851d-f4ba81735a22 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:38.272515 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62961b1e-3c0a-444a-851d-f4ba81735a22 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:38.272895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62961b1e-3c0a-444a-851d-f4ba81735a22 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:38.273657 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62961b1e-3c0a-444a-851d-f4ba81735a22 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:38.274083 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62961b1e-3c0a-444a-851d-f4ba81735a22 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:38.296275 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a7d883c5-0a14-46eb-8f96-215950881aad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:38.304814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a7d883c5-0a14-46eb-8f96-215950881aad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.156140 Jul 14 11:13:38.305555 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 330/652] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:38 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:38.410725 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62961b1e-3c0a-444a-851d-f4ba81735a22 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:38.414254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:38.419210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62961b1e-3c0a-444a-851d-f4ba81735a22 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1367 microversion: 2.1 time: 0.158803 Jul 14 11:13:38.421354 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 323/653] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:38 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:13:39.322236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7d1d9422-4881-40ce-b882-789c56e761c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:39.322925 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7d1d9422-4881-40ce-b882-789c56e761c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:39.324811 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:39.330694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d1d9422-4881-40ce-b882-789c56e761c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:39.331145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d1d9422-4881-40ce-b882-789c56e761c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:39.331960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d1d9422-4881-40ce-b882-789c56e761c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:39.332405 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d1d9422-4881-40ce-b882-789c56e761c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:39.436329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ae7822d9-3379-44f9-b105-463dc5c2f739 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:39.436938 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ae7822d9-3379-44f9-b105-463dc5c2f739 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:39.439269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:39.439960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:39.448474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae7822d9-3379-44f9-b105-463dc5c2f739 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:39.448926 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae7822d9-3379-44f9-b105-463dc5c2f739 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:39.449712 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae7822d9-3379-44f9-b105-463dc5c2f739 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:39.450146 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae7822d9-3379-44f9-b105-463dc5c2f739 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:39.472601 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7d1d9422-4881-40ce-b882-789c56e761c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:39.480204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7d1d9422-4881-40ce-b882-789c56e761c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.161876 Jul 14 11:13:39.480785 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 331/654] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:39 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:39.592220 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ae7822d9-3379-44f9-b105-463dc5c2f739 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:39.600348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ae7822d9-3379-44f9-b105-463dc5c2f739 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1367 microversion: 2.1 time: 0.167848 Jul 14 11:13:39.600929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 324/655] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:39 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:13:40.505255 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-24b3dfa1-c00f-4b62-9216-51113619b583 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:40.505858 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-24b3dfa1-c00f-4b62-9216-51113619b583 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:40.512780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-24b3dfa1-c00f-4b62-9216-51113619b583 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:40.513400 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-24b3dfa1-c00f-4b62-9216-51113619b583 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:40.514339 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-24b3dfa1-c00f-4b62-9216-51113619b583 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:40.514813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-24b3dfa1-c00f-4b62-9216-51113619b583 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:40.617285 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ba5a49db-29b7-44db-9fc4-e58bcdf5f33e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:40.618039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ba5a49db-29b7-44db-9fc4-e58bcdf5f33e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:40.624688 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba5a49db-29b7-44db-9fc4-e58bcdf5f33e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:40.625141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba5a49db-29b7-44db-9fc4-e58bcdf5f33e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:40.625914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba5a49db-29b7-44db-9fc4-e58bcdf5f33e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:40.626351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba5a49db-29b7-44db-9fc4-e58bcdf5f33e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:40.648085 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-24b3dfa1-c00f-4b62-9216-51113619b583 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:40.655549 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-24b3dfa1-c00f-4b62-9216-51113619b583 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.155075 Jul 14 11:13:40.656633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 332/656] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:40 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:40.756712 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ba5a49db-29b7-44db-9fc4-e58bcdf5f33e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:40.764418 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ba5a49db-29b7-44db-9fc4-e58bcdf5f33e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1558 microversion: 2.1 time: 0.151194 Jul 14 11:13:40.764994 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 325/657] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:40 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:13:40.781178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1b517041-d5a0-44ed-a1ab-a41660759039 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:40.781670 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1b517041-d5a0-44ed-a1ab-a41660759039 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:40.787883 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b517041-d5a0-44ed-a1ab-a41660759039 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:40.788328 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b517041-d5a0-44ed-a1ab-a41660759039 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:40.789086 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b517041-d5a0-44ed-a1ab-a41660759039 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:40.789517 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b517041-d5a0-44ed-a1ab-a41660759039 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:40.866286 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1b517041-d5a0-44ed-a1ab-a41660759039 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089339 Jul 14 11:13:40.866880 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 333/658] 10.222.0.75 () {58 vars in 1274 bytes} [Thu Jul 14 11:13:40 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:41.672866 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-00e7f30f-6371-48a4-a098-5fdda9d90926 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:41.673566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-00e7f30f-6371-48a4-a098-5fdda9d90926 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:41.680368 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00e7f30f-6371-48a4-a098-5fdda9d90926 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:41.680819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00e7f30f-6371-48a4-a098-5fdda9d90926 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:41.681575 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00e7f30f-6371-48a4-a098-5fdda9d90926 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:41.682007 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00e7f30f-6371-48a4-a098-5fdda9d90926 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:41.815901 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-2d9c9525-945f-464f-a563-3f7ba70f2ab6 req-c9bbadbd-629c-4d67-9088-8efbfa4c88e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5638369-b1e6-4b47-a77e-1e875bac6038", "tag": "1d18c91d-ab99-42c3-b298-881ad82fb9fa"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:41.824739 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-2d9c9525-945f-464f-a563-3f7ba70f2ab6 req-c9bbadbd-629c-4d67-9088-8efbfa4c88e5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:41.825786 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-2d9c9525-945f-464f-a563-3f7ba70f2ab6 req-c9bbadbd-629c-4d67-9088-8efbfa4c88e5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:41.828299 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-00e7f30f-6371-48a4-a098-5fdda9d90926 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:41.838630 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-2d9c9525-945f-464f-a563-3f7ba70f2ab6 req-c9bbadbd-629c-4d67-9088-8efbfa4c88e5 service nova] Creating event network-changed:1d18c91d-ab99-42c3-b298-881ad82fb9fa for instance d5638369-b1e6-4b47-a77e-1e875bac6038 on hv-cinder-84893 Jul 14 11:13:41.839989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-00e7f30f-6371-48a4-a098-5fdda9d90926 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.171269 Jul 14 11:13:41.840791 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 326/659] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:41 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:41.844597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-2d9c9525-945f-464f-a563-3f7ba70f2ab6 req-c9bbadbd-629c-4d67-9088-8efbfa4c88e5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033545 Jul 14 11:13:41.845797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 334/660] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:42.857716 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f0a339d0-aa28-4f0f-a3e8-acf95ac6ef7a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:42.858252 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f0a339d0-aa28-4f0f-a3e8-acf95ac6ef7a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:42.864809 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0a339d0-aa28-4f0f-a3e8-acf95ac6ef7a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:42.865255 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0a339d0-aa28-4f0f-a3e8-acf95ac6ef7a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:42.866029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0a339d0-aa28-4f0f-a3e8-acf95ac6ef7a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:42.866464 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0a339d0-aa28-4f0f-a3e8-acf95ac6ef7a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:43.003284 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f0a339d0-aa28-4f0f-a3e8-acf95ac6ef7a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:43.010898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f0a339d0-aa28-4f0f-a3e8-acf95ac6ef7a tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.157161 Jul 14 11:13:43.011677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 327/661] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:42 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:44.028424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ee78dd64-f11e-471e-8485-a97189dd3217 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:44.029124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ee78dd64-f11e-471e-8485-a97189dd3217 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:44.036383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee78dd64-f11e-471e-8485-a97189dd3217 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:44.036833 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee78dd64-f11e-471e-8485-a97189dd3217 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:44.037599 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee78dd64-f11e-471e-8485-a97189dd3217 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:44.038032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee78dd64-f11e-471e-8485-a97189dd3217 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:44.169957 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ee78dd64-f11e-471e-8485-a97189dd3217 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:44.177784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ee78dd64-f11e-471e-8485-a97189dd3217 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.153478 Jul 14 11:13:44.178629 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 335/662] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:44 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:45.195954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eaa27a8d-ceeb-40c5-a6bd-79afba6377d1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:45.196348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eaa27a8d-ceeb-40c5-a6bd-79afba6377d1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:45.202874 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eaa27a8d-ceeb-40c5-a6bd-79afba6377d1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:45.203331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eaa27a8d-ceeb-40c5-a6bd-79afba6377d1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:45.204124 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eaa27a8d-ceeb-40c5-a6bd-79afba6377d1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:45.204559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eaa27a8d-ceeb-40c5-a6bd-79afba6377d1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:45.333658 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eaa27a8d-ceeb-40c5-a6bd-79afba6377d1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:45.341277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eaa27a8d-ceeb-40c5-a6bd-79afba6377d1 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.149609 Jul 14 11:13:45.341838 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 328/663] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:45 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:46.360422 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7b74cc91-352c-49a4-9731-12f0298d269d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:46.361044 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7b74cc91-352c-49a4-9731-12f0298d269d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:46.363503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:46.368818 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b74cc91-352c-49a4-9731-12f0298d269d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:46.369267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b74cc91-352c-49a4-9731-12f0298d269d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:46.370032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b74cc91-352c-49a4-9731-12f0298d269d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:46.370496 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b74cc91-352c-49a4-9731-12f0298d269d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:46.520296 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7b74cc91-352c-49a4-9731-12f0298d269d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:46.532653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7b74cc91-352c-49a4-9731-12f0298d269d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.176252 Jul 14 11:13:46.533234 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 336/664] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:46 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:46.779202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-acd03092-f604-4158-bb2d-1dd20cc4d267 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:46.779772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-acd03092-f604-4158-bb2d-1dd20cc4d267 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:46.782407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:46.788361 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-acd03092-f604-4158-bb2d-1dd20cc4d267 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:46.788837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-acd03092-f604-4158-bb2d-1dd20cc4d267 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:46.789602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-acd03092-f604-4158-bb2d-1dd20cc4d267 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:46.790037 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-acd03092-f604-4158-bb2d-1dd20cc4d267 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:46.827902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-acd03092-f604-4158-bb2d-1dd20cc4d267 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments/4169c2de-0281-414e-837e-fe0105db6b9a" status: 200 len: 194 microversion: 2.20 time: 0.052676 Jul 14 11:13:46.828497 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 329/665] 10.222.0.75 () {60 vars in 1453 bytes} [Thu Jul 14 11:13:46 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments/4169c2de-0281-414e-837e-fe0105db6b9a => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:13:46.893020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-72351d39-0ed9-4655-a732-fd1e5d2a2aad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:46.893510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-72351d39-0ed9-4655-a732-fd1e5d2a2aad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:46.900038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72351d39-0ed9-4655-a732-fd1e5d2a2aad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:46.900497 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72351d39-0ed9-4655-a732-fd1e5d2a2aad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:46.901239 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72351d39-0ed9-4655-a732-fd1e5d2a2aad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:46.901672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72351d39-0ed9-4655-a732-fd1e5d2a2aad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:46.982810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-72351d39-0ed9-4655-a732-fd1e5d2a2aad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lazy-loading 'services' on Instance uuid 4d03bde1-0583-4099-8098-0077a2fc1084 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:13:47.055012 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-72351d39-0ed9-4655-a732-fd1e5d2a2aad tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "DELETE /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments/4169c2de-0281-414e-837e-fe0105db6b9a" status: 202 len: 0 microversion: 2.20 time: 0.166396 Jul 14 11:13:47.055634 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 337/666] 10.222.0.75 () {60 vars in 1456 bytes} [Thu Jul 14 11:13:46 2022] DELETE /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments/4169c2de-0281-414e-837e-fe0105db6b9a => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:13:47.063968 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6bd2cf01-9010-4de5-a852-58aedbe2858d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:47.064949 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6bd2cf01-9010-4de5-a852-58aedbe2858d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:47.071066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6bd2cf01-9010-4de5-a852-58aedbe2858d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:47.071708 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6bd2cf01-9010-4de5-a852-58aedbe2858d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:47.072641 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6bd2cf01-9010-4de5-a852-58aedbe2858d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:47.073182 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6bd2cf01-9010-4de5-a852-58aedbe2858d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:47.105857 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6bd2cf01-9010-4de5-a852-58aedbe2858d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045746 Jul 14 11:13:47.106425 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 330/667] 10.222.0.75 () {60 vars in 1342 bytes} [Thu Jul 14 11:13:47 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:13:47.550704 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ee8f6238-2e8c-4f5e-a94d-1e447956ee58 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:47.551408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ee8f6238-2e8c-4f5e-a94d-1e447956ee58 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:47.558495 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee8f6238-2e8c-4f5e-a94d-1e447956ee58 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:47.558938 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee8f6238-2e8c-4f5e-a94d-1e447956ee58 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:47.559736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee8f6238-2e8c-4f5e-a94d-1e447956ee58 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:47.560162 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ee8f6238-2e8c-4f5e-a94d-1e447956ee58 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:47.698460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ee8f6238-2e8c-4f5e-a94d-1e447956ee58 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:47.706152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ee8f6238-2e8c-4f5e-a94d-1e447956ee58 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.159724 Jul 14 11:13:47.706736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 338/668] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:47 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:48.118039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3d78d1bb-65d6-4fad-95fb-c9b15a0ec247 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:48.118991 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3d78d1bb-65d6-4fad-95fb-c9b15a0ec247 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:48.125509 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d78d1bb-65d6-4fad-95fb-c9b15a0ec247 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:48.125954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d78d1bb-65d6-4fad-95fb-c9b15a0ec247 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:48.126719 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d78d1bb-65d6-4fad-95fb-c9b15a0ec247 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:48.127153 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d78d1bb-65d6-4fad-95fb-c9b15a0ec247 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:48.155008 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3d78d1bb-65d6-4fad-95fb-c9b15a0ec247 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040818 Jul 14 11:13:48.156010 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 331/669] 10.222.0.75 () {60 vars in 1342 bytes} [Thu Jul 14 11:13:48 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:48.214406 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5ecc5a2b-c1a9-4335-a627-644c4d86636f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:48.214896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5ecc5a2b-c1a9-4335-a627-644c4d86636f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:48.221477 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ecc5a2b-c1a9-4335-a627-644c4d86636f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:48.221922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ecc5a2b-c1a9-4335-a627-644c4d86636f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:48.222683 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ecc5a2b-c1a9-4335-a627-644c4d86636f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:48.223117 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ecc5a2b-c1a9-4335-a627-644c4d86636f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:48.249109 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5ecc5a2b-c1a9-4335-a627-644c4d86636f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:13:48.323991 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5ecc5a2b-c1a9-4335-a627-644c4d86636f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "DELETE /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 204 len: 0 microversion: 2.20 time: 0.113211 Jul 14 11:13:48.324575 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 339/670] 10.222.0.75 () {60 vars in 1279 bytes} [Thu Jul 14 11:13:48 2022] DELETE /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:13:48.333560 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:48.334234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:48.340449 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:48.340755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:48.341525 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:48.341959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:48.478061 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:48.486116 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:48.487653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:48.488836 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1fd87da6-f13e-4b82-b038-e6d6abcdbe8d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.159410 Jul 14 11:13:48.489394 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 332/671] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:48 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:13:48.724921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9b8499cd-25b5-4ce7-a4b0-471b1ea4ff9f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:48.725537 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9b8499cd-25b5-4ce7-a4b0-471b1ea4ff9f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:48.732094 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b8499cd-25b5-4ce7-a4b0-471b1ea4ff9f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:48.732548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b8499cd-25b5-4ce7-a4b0-471b1ea4ff9f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:48.733314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b8499cd-25b5-4ce7-a4b0-471b1ea4ff9f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:48.734381 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b8499cd-25b5-4ce7-a4b0-471b1ea4ff9f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:48.868134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b8499cd-25b5-4ce7-a4b0-471b1ea4ff9f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:48.875606 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9b8499cd-25b5-4ce7-a4b0-471b1ea4ff9f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.155030 Jul 14 11:13:48.876169 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 340/672] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:48 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:49.506433 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:49.507002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:49.513850 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:49.514305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:49.515781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:49.516220 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:49.646098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:49.653790 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:49.655268 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:49.656443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b82b1f9-2555-4bae-b2bf-0cb252a419dc tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.153978 Jul 14 11:13:49.656991 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 333/673] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:49 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:13:49.892619 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e58c14a0-876e-49b3-ab73-2a89cabea001 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:49.893229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e58c14a0-876e-49b3-ab73-2a89cabea001 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:49.899812 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e58c14a0-876e-49b3-ab73-2a89cabea001 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:49.900267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e58c14a0-876e-49b3-ab73-2a89cabea001 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:49.901033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e58c14a0-876e-49b3-ab73-2a89cabea001 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:49.901526 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e58c14a0-876e-49b3-ab73-2a89cabea001 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:50.033037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e58c14a0-876e-49b3-ab73-2a89cabea001 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:50.040806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e58c14a0-876e-49b3-ab73-2a89cabea001 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.152041 Jul 14 11:13:50.041407 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 341/674] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:49 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:50.674312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:50.674926 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:50.681626 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:50.682207 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:50.682842 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:50.683359 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:50.816094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:50.824445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:50.825940 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:50.827098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-58eb4fc2-bb08-4e13-8e1d-9f70e43662be tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1724 microversion: 2.20 time: 0.156830 Jul 14 11:13:50.828514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 334/675] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:50 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:13:51.065487 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-71e597ba-8c9a-4c4a-9f82-d2ad40f0d894 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:51.066214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-71e597ba-8c9a-4c4a-9f82-d2ad40f0d894 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:51.073362 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-71e597ba-8c9a-4c4a-9f82-d2ad40f0d894 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:51.073912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-71e597ba-8c9a-4c4a-9f82-d2ad40f0d894 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:51.074777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-71e597ba-8c9a-4c4a-9f82-d2ad40f0d894 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:51.075290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-71e597ba-8c9a-4c4a-9f82-d2ad40f0d894 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:51.307067 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-71e597ba-8c9a-4c4a-9f82-d2ad40f0d894 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:51.315276 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-71e597ba-8c9a-4c4a-9f82-d2ad40f0d894 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1674 microversion: 2.1 time: 0.254170 Jul 14 11:13:51.315887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 342/676] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:51 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:51.388004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-efdc26c0-7d01-4133-944a-c9e294a9b41a req-3d899206-9e3e-4bf4-9847-b302454eb7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d03bde1-0583-4099-8098-0077a2fc1084", "name": "network-vif-deleted", "tag": "81b715b1-2ff3-4295-9104-d4e547039e70"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:51.406624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-efdc26c0-7d01-4133-944a-c9e294a9b41a req-3d899206-9e3e-4bf4-9847-b302454eb7a5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:51.407072 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-efdc26c0-7d01-4133-944a-c9e294a9b41a req-3d899206-9e3e-4bf4-9847-b302454eb7a5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:51.423175 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-efdc26c0-7d01-4133-944a-c9e294a9b41a req-3d899206-9e3e-4bf4-9847-b302454eb7a5 service nova] Creating event network-vif-deleted:81b715b1-2ff3-4295-9104-d4e547039e70 for instance 4d03bde1-0583-4099-8098-0077a2fc1084 on hv-cinder-84893 Jul 14 11:13:51.431153 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-efdc26c0-7d01-4133-944a-c9e294a9b41a req-3d899206-9e3e-4bf4-9847-b302454eb7a5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048343 Jul 14 11:13:51.431825 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 335/677] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:51.847338 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:51.848145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:51.854200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:51.854889 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:51.855711 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:51.856560 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:51.890887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:51.891338 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:51.891818 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lazy-loading 'fault' on Instance uuid 4d03bde1-0583-4099-8098-0077a2fc1084 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:13:51.941504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:51.950656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:51.952504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:51.953691 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-700a1df7-08bd-4e8d-a443-cd6cc592f977 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 200 len: 1371 microversion: 2.20 time: 0.111546 Jul 14 11:13:51.960046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 343/678] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:51 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:13:52.334049 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2ce1268-4dc7-4512-98d6-0cc63c7dca53 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:52.334779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2ce1268-4dc7-4512-98d6-0cc63c7dca53 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:52.342134 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2ce1268-4dc7-4512-98d6-0cc63c7dca53 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:52.342441 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2ce1268-4dc7-4512-98d6-0cc63c7dca53 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:52.343839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2ce1268-4dc7-4512-98d6-0cc63c7dca53 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:52.344422 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2ce1268-4dc7-4512-98d6-0cc63c7dca53 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:52.488358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2ce1268-4dc7-4512-98d6-0cc63c7dca53 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:52.496142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2ce1268-4dc7-4512-98d6-0cc63c7dca53 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1651 microversion: 2.1 time: 0.166855 Jul 14 11:13:52.496769 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 336/679] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:52 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1651 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:52.516200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dc373667-90a3-4d4d-9b21-3ef668a0cdd9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:52.522675 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dc373667-90a3-4d4d-9b21-3ef668a0cdd9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:52.523135 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dc373667-90a3-4d4d-9b21-3ef668a0cdd9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:52.544763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dc373667-90a3-4d4d-9b21-3ef668a0cdd9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Going to try to start instance {{(pid=117888) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 11:13:52.569087 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:52.589786 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dc373667-90a3-4d4d-9b21-3ef668a0cdd9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/action" status: 202 len: 0 microversion: 2.1 time: 0.077930 Jul 14 11:13:52.590421 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 344/680] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:13:52 2022] POST /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:13:52.599134 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4c76e973-2f1d-466b-a341-bcb2c437e829 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:52.599609 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4c76e973-2f1d-466b-a341-bcb2c437e829 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:52.606092 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c76e973-2f1d-466b-a341-bcb2c437e829 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:52.606539 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c76e973-2f1d-466b-a341-bcb2c437e829 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:52.607420 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c76e973-2f1d-466b-a341-bcb2c437e829 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:52.607858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c76e973-2f1d-466b-a341-bcb2c437e829 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:52.752323 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4c76e973-2f1d-466b-a341-bcb2c437e829 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:52.759958 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4c76e973-2f1d-466b-a341-bcb2c437e829 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1660 microversion: 2.1 time: 0.165144 Jul 14 11:13:52.760529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 337/681] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:52 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1660 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:52.972740 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:52.973430 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:52.981104 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:52.981555 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:52.982321 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:52.982752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:52.999927 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] HTTP exception thrown: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Request method failure captured: Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 HTTP/1.1 Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_jxdiQ8lO3bza3KlvJ0I0L4MqWzwqsjqAltuSK13rRv6MXvOR-wVSYLK6oKJBFqtwx7YdkJPH7GHjwbKnGlQR4I3zeUEh6VW3ZPhqtkZcuGOiy5Bg-gkwFJvpQSGxw_JxTIPMwoyEFBCdVc7cG9pfIUmSHohpLAfBBVUvqz458vCOI Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:13:53.001562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9b56ea0be2964e21985deb5964232923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9b56ea0be2964e21985deb5964232923", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: bf3817e18de149aba43a2f65f37d63f4 Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:13:53.003195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '4d03bde1-0583-4099-8098-0077a2fc1084'} Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:13:53.004072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:13:53.005314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:13:53.006408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Returning 404 to user: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:13:53.006408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a24e7221-f97c-4726-96e6-2836e3945271 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 404 len: 111 microversion: 2.20 time: 0.034512 Jul 14 11:13:53.006408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 345/682] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:52 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:13:53.012622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c78b8608-af35-4431-9823-09c0472be68d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '.version_select at 0x7f579e020a60>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:53.030230 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c78b8608-af35-4431-9823-09c0472be68d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080411651" status: 204 len: 0 microversion: 2.20 time: 0.021438 Jul 14 11:13:53.030822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 338/683] 10.222.0.75 () {60 vars in 1261 bytes} [Thu Jul 14 11:13:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080411651 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:13:53.729447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-791e0b62-7fae-415b-98d1-5f09d7d230ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'create', calling method: .version_select at 0x7f579df4e0d0>, body: {"keypair": {"name": "tempest-keypair-979136228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvXiKZb1sCUhvUJCsnM7ePLwFm8sSW+JjtpvP1lJw/iEDYrSbZUtXb6oSFi6eNo+RpGuMkqUsdYGJ73YAsybsL2YupkSMsk+ZXipyUs8JzuuxvnfNQ3lYbasKN/iN34Wg=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:53.743723 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-791e0b62-7fae-415b-98d1-5f09d7d230ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Getting quotas for project 9b56ea0be2964e21985deb5964232923. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:13:53.747652 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-791e0b62-7fae-415b-98d1-5f09d7d230ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Getting quotas for user bf3817e18de149aba43a2f65f37d63f4 and project 9b56ea0be2964e21985deb5964232923. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:13:53.769931 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-791e0b62-7fae-415b-98d1-5f09d7d230ea tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044223 Jul 14 11:13:53.770531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 346/684] 10.222.0.75 () {62 vars in 1199 bytes} [Thu Jul 14 11:13:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 11:13:53.777483 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d414a676-5438-4f11-9a5f-584824fa6566 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:53.778101 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d414a676-5438-4f11-9a5f-584824fa6566 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:53.784906 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d414a676-5438-4f11-9a5f-584824fa6566 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:53.785357 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d414a676-5438-4f11-9a5f-584824fa6566 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:53.786138 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d414a676-5438-4f11-9a5f-584824fa6566 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:53.786573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d414a676-5438-4f11-9a5f-584824fa6566 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:53.931587 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d414a676-5438-4f11-9a5f-584824fa6566 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:53.941746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d414a676-5438-4f11-9a5f-584824fa6566 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1660 microversion: 2.1 time: 0.167830 Jul 14 11:13:53.943680 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 339/685] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:53 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1660 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:54.959934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bbdab1b9-3127-48af-805d-62c6231fc376 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:54.960546 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bbdab1b9-3127-48af-805d-62c6231fc376 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:54.968407 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbdab1b9-3127-48af-805d-62c6231fc376 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:54.968867 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbdab1b9-3127-48af-805d-62c6231fc376 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:54.969652 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbdab1b9-3127-48af-805d-62c6231fc376 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:54.970090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbdab1b9-3127-48af-805d-62c6231fc376 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:55.049440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-901496954", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90ec2180-c51d-4c74-aa35-68c20d17fb42"}], "security_groups": [{"name": "tempest-securitygroup--1574013970"}], "key_name": "tempest-keypair-979136228", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:55.108004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bbdab1b9-3127-48af-805d-62c6231fc376 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:55.116836 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bbdab1b9-3127-48af-805d-62c6231fc376 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1664 microversion: 2.1 time: 0.161192 Jul 14 11:13:55.117518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 347/686] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:13:54 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:13:55.153254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] validate_networks() for [('90ec2180-c51d-4c74-aa35-68c20d17fb42', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:13:55.526951 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:13:55.527368 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:13:55.527894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:13:55.528301 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:13:55.528700 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:13:55.537678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:55.538210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:55.539071 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:55.539534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:55.556103 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Getting quotas for project 9b56ea0be2964e21985deb5964232923. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:13:55.560002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Getting quotas for user bf3817e18de149aba43a2f65f37d63f4 and project 9b56ea0be2964e21985deb5964232923. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:13:55.571163 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:13:55.573441 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:13:55.621095 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-90bb3d25-90ec-4182-b2be-586ab4e77544 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.576554 Jul 14 11:13:55.621760 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 340/687] 10.222.0.75 () {62 vars in 1187 bytes} [Thu Jul 14 11:13:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 14 11:13:55.632280 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e20af37a-b7d7-4dcd-a47b-4ae4ebacd8b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:55.632885 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e20af37a-b7d7-4dcd-a47b-4ae4ebacd8b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:55.685387 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e20af37a-b7d7-4dcd-a47b-4ae4ebacd8b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:55.693191 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e20af37a-b7d7-4dcd-a47b-4ae4ebacd8b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:55.694730 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e20af37a-b7d7-4dcd-a47b-4ae4ebacd8b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:55.695872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e20af37a-b7d7-4dcd-a47b-4ae4ebacd8b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1280 microversion: 2.20 time: 0.067528 Jul 14 11:13:55.696627 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 348/688] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:55 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:13:56.715651 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:56.716254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:56.723949 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:56.724760 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:56.725763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:56.726190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:56.792530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:56.802867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:56.805778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:56.806474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc7c5006-2da3-4788-bf46-008d211c8cff tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1350 microversion: 2.20 time: 0.095272 Jul 14 11:13:56.807297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 341/689] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:56 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:13:57.825877 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:57.826483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:57.834259 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:57.834707 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:57.835772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:57.836205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:58.049047 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:58.058252 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:58.059834 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:58.061136 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-05b3582f-d3b2-4c83-b2f0-cf053522a464 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.239426 Jul 14 11:13:58.061697 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 349/690] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:57 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:13:58.173947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-44f69e40-bc44-44bc-8cf3-37acfcdff604 req-d07ef592-62df-4fcc-b7dd-56eaab4fe998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431", "tag": "6a60328d-ee1e-44d3-8008-6151b2c4427f"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:13:58.186934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-44f69e40-bc44-44bc-8cf3-37acfcdff604 req-d07ef592-62df-4fcc-b7dd-56eaab4fe998 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:58.187376 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-44f69e40-bc44-44bc-8cf3-37acfcdff604 req-d07ef592-62df-4fcc-b7dd-56eaab4fe998 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:58.202962 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-44f69e40-bc44-44bc-8cf3-37acfcdff604 req-d07ef592-62df-4fcc-b7dd-56eaab4fe998 service nova] Creating event network-changed:6a60328d-ee1e-44d3-8008-6151b2c4427f for instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 on hv-cinder-84893 Jul 14 11:13:58.211799 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-44f69e40-bc44-44bc-8cf3-37acfcdff604 req-d07ef592-62df-4fcc-b7dd-56eaab4fe998 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042795 Jul 14 11:13:58.213334 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 342/691] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:13:59.079617 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:13:59.080283 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:13:59.086651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:59.087090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:59.087880 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:13:59.088310 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:13:59.218388 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:59.227013 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:59.228537 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:13:59.229659 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-adb7ec59-9e5c-4178-b2cf-49eed3967133 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.154005 Jul 14 11:13:59.230254 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 350/692] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:13:59 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:14:00.140278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c34b50d5-d47b-4311-8f77-824c5aa58f55 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:00.140855 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c34b50d5-d47b-4311-8f77-824c5aa58f55 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:00.148191 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c34b50d5-d47b-4311-8f77-824c5aa58f55 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:00.148644 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c34b50d5-d47b-4311-8f77-824c5aa58f55 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:00.149405 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c34b50d5-d47b-4311-8f77-824c5aa58f55 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:00.149842 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c34b50d5-d47b-4311-8f77-824c5aa58f55 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:00.211708 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:00.248781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:00.249910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:00.256988 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:00.257439 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:00.258235 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:00.258674 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:00.274799 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-c34b50d5-d47b-4311-8f77-824c5aa58f55 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lazy-loading 'services' on Instance uuid fe2921e8-d6f6-4bcd-a5bd-a02da1353800 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:14:00.390249 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c34b50d5-d47b-4311-8f77-824c5aa58f55 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "DELETE /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments/d96676fd-dad7-49c6-8d93-946261f011b2" status: 202 len: 0 microversion: 2.1 time: 0.253995 Jul 14 11:14:00.390827 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 343/693] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:14:00 2022] DELETE /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments/d96676fd-dad7-49c6-8d93-946261f011b2 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:14:00.396770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:00.399613 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cf5813de-b474-47f4-8890-422f03fcdcf2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:00.400624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cf5813de-b474-47f4-8890-422f03fcdcf2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:00.405073 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:00.406600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:00.406748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf5813de-b474-47f4-8890-422f03fcdcf2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:00.407152 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf5813de-b474-47f4-8890-422f03fcdcf2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:00.407720 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6f900279-0db0-4cff-8345-49ea4c367d14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.163511 Jul 14 11:14:00.407955 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf5813de-b474-47f4-8890-422f03fcdcf2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:00.408277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 351/694] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:14:00 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:14:00.408379 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf5813de-b474-47f4-8890-422f03fcdcf2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:00.439331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cf5813de-b474-47f4-8890-422f03fcdcf2 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Jul 14 11:14:00.440572 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 344/695] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:14:00 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:14:01.425447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:01.426077 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:01.432998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:01.433894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:01.434220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:01.434650 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:01.450715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a29ae703-194d-4fdb-a220-411c57c8ac8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:01.451565 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a29ae703-194d-4fdb-a220-411c57c8ac8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:01.458666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a29ae703-194d-4fdb-a220-411c57c8ac8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:01.459111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a29ae703-194d-4fdb-a220-411c57c8ac8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:01.459903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a29ae703-194d-4fdb-a220-411c57c8ac8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:01.460333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a29ae703-194d-4fdb-a220-411c57c8ac8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:01.490129 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a29ae703-194d-4fdb-a220-411c57c8ac8b tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 Jul 14 11:14:01.490699 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 345/696] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:14:01 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:14:01.568445 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:01.576229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:01.577728 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:01.579598 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bf830fb7-152b-4cd2-a5d8-c6d0637802c5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.157911 Jul 14 11:14:01.580172 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 352/697] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:14:01 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:14:02.503957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-753f0ffb-6247-47e2-9b81-2056e44cba8c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:02.504837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-753f0ffb-6247-47e2-9b81-2056e44cba8c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:02.512443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-753f0ffb-6247-47e2-9b81-2056e44cba8c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:02.512898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-753f0ffb-6247-47e2-9b81-2056e44cba8c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:02.513675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-753f0ffb-6247-47e2-9b81-2056e44cba8c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:02.514110 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-753f0ffb-6247-47e2-9b81-2056e44cba8c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:02.542920 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-753f0ffb-6247-47e2-9b81-2056e44cba8c tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044884 Jul 14 11:14:02.543492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 346/698] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:14:02 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:14:02.598662 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:02.599267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:02.606915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:02.607481 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:02.608460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:02.609008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:02.616103 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d96178ea-1061-4e69-8658-1a06a43d7ae9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:02.616592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d96178ea-1061-4e69-8658-1a06a43d7ae9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:02.622525 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d96178ea-1061-4e69-8658-1a06a43d7ae9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:02.622979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d96178ea-1061-4e69-8658-1a06a43d7ae9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:02.623772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d96178ea-1061-4e69-8658-1a06a43d7ae9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:02.624202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d96178ea-1061-4e69-8658-1a06a43d7ae9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:02.649221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d96178ea-1061-4e69-8658-1a06a43d7ae9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:14:02.730001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d96178ea-1061-4e69-8658-1a06a43d7ae9 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "DELETE /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 204 len: 0 microversion: 2.1 time: 0.117282 Jul 14 11:14:02.733491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 347/699] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:14:02 2022] DELETE /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:14:02.739513 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9913b5dc-fdc1-413e-9d01-47434993c57d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:02.740219 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9913b5dc-fdc1-413e-9d01-47434993c57d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:02.746184 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9913b5dc-fdc1-413e-9d01-47434993c57d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:02.746636 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9913b5dc-fdc1-413e-9d01-47434993c57d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:02.747459 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9913b5dc-fdc1-413e-9d01-47434993c57d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:02.747930 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9913b5dc-fdc1-413e-9d01-47434993c57d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:02.748777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:02.756802 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:02.758317 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:02.759445 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-db6a22c9-2b5a-46ff-8511-daae92b9e015 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.166060 Jul 14 11:14:02.760045 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 353/700] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:14:02 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:14:02.880297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9913b5dc-fdc1-413e-9d01-47434993c57d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:02.887806 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9913b5dc-fdc1-413e-9d01-47434993c57d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1684 microversion: 2.1 time: 0.152919 Jul 14 11:14:02.888376 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 348/701] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:02 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:03.778018 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:03.778695 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:03.785604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:03.786055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:03.786816 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:03.787254 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:03.842318 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4955cfc2-5cfa-4354-80f9-e317905e09b3 req-a472b1e3-460d-48d1-a976-324764ab8999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431", "name": "network-vif-plugged", "status": "completed", "tag": "6a60328d-ee1e-44d3-8008-6151b2c4427f"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:14:03.853054 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4955cfc2-5cfa-4354-80f9-e317905e09b3 req-a472b1e3-460d-48d1-a976-324764ab8999 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:03.853493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4955cfc2-5cfa-4354-80f9-e317905e09b3 req-a472b1e3-460d-48d1-a976-324764ab8999 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:03.867629 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4955cfc2-5cfa-4354-80f9-e317905e09b3 req-a472b1e3-460d-48d1-a976-324764ab8999 service nova] Creating event network-vif-plugged:6a60328d-ee1e-44d3-8008-6151b2c4427f for instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 on hv-cinder-84893 Jul 14 11:14:03.872548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4955cfc2-5cfa-4354-80f9-e317905e09b3 req-a472b1e3-460d-48d1-a976-324764ab8999 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036828 Jul 14 11:14:03.873298 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 349/702] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:14:03.909046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f38df844-35b4-436c-9396-f1e501ab7cac tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:03.909800 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f38df844-35b4-436c-9396-f1e501ab7cac tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:03.916590 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f38df844-35b4-436c-9396-f1e501ab7cac tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:03.917174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f38df844-35b4-436c-9396-f1e501ab7cac tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:03.918146 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f38df844-35b4-436c-9396-f1e501ab7cac tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:03.918930 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f38df844-35b4-436c-9396-f1e501ab7cac tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:03.932237 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:03.941855 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:03.943347 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:03.944487 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dcdc03f5-d3c8-4c37-8d86-a6f646e13c0b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.170548 Jul 14 11:14:03.945045 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 354/703] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:14:03 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:14:04.064540 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f38df844-35b4-436c-9396-f1e501ab7cac tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:04.072472 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f38df844-35b4-436c-9396-f1e501ab7cac tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1684 microversion: 2.1 time: 0.171435 Jul 14 11:14:04.073073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 350/704] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:03 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:14:04.964920 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:04.965517 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:04.972067 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:04.972505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:04.973253 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:04.973681 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:05.089791 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6ca0d051-cf6c-4246-a067-1e20793d29d3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:05.090387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6ca0d051-cf6c-4246-a067-1e20793d29d3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:05.096807 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ca0d051-cf6c-4246-a067-1e20793d29d3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:05.097256 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ca0d051-cf6c-4246-a067-1e20793d29d3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:05.098021 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ca0d051-cf6c-4246-a067-1e20793d29d3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:05.098459 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ca0d051-cf6c-4246-a067-1e20793d29d3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:05.103672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:05.111007 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:05.112566 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:05.113683 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d24b85b2-e875-46cd-842f-ad7cb3fe5c66 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.152667 Jul 14 11:14:05.114274 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 355/705] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:14:04 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:14:05.227270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6ca0d051-cf6c-4246-a067-1e20793d29d3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:05.235541 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6ca0d051-cf6c-4246-a067-1e20793d29d3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1684 microversion: 2.1 time: 0.148935 Jul 14 11:14:05.236111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 351/706] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:05 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:14:06.131771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:06.132380 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:06.134341 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:06.140062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:06.140516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:06.141352 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:06.141793 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:06.252796 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f3975969-af26-4b58-bd39-edcc6f50094d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:06.253470 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f3975969-af26-4b58-bd39-edcc6f50094d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:06.255293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:06.256075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:06.262565 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3975969-af26-4b58-bd39-edcc6f50094d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:06.263015 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3975969-af26-4b58-bd39-edcc6f50094d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:06.263809 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3975969-af26-4b58-bd39-edcc6f50094d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:06.264242 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3975969-af26-4b58-bd39-edcc6f50094d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:06.314562 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:06.322840 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:06.324384 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:06.325485 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f5fde304-1993-4c31-94ee-301032c6ff71 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.197716 Jul 14 11:14:06.326053 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 356/707] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:14:06 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:14:06.398768 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f3975969-af26-4b58-bd39-edcc6f50094d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:06.406257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f3975969-af26-4b58-bd39-edcc6f50094d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1684 microversion: 2.1 time: 0.157387 Jul 14 11:14:06.407436 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 352/708] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:06 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:14:07.344766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:07.345373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:07.352838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:07.353286 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:07.354054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:07.354488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:07.424680 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88c6d0a4-0ec2-4b0b-8131-56a835c26f20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:07.425329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88c6d0a4-0ec2-4b0b-8131-56a835c26f20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:07.432508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88c6d0a4-0ec2-4b0b-8131-56a835c26f20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:07.433292 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88c6d0a4-0ec2-4b0b-8131-56a835c26f20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:07.434630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88c6d0a4-0ec2-4b0b-8131-56a835c26f20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:07.435333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88c6d0a4-0ec2-4b0b-8131-56a835c26f20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:07.581737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88c6d0a4-0ec2-4b0b-8131-56a835c26f20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:07.589391 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88c6d0a4-0ec2-4b0b-8131-56a835c26f20 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1684 microversion: 2.1 time: 0.169127 Jul 14 11:14:07.590267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 353/709] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:07 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:07.592226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:07.600426 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:07.601933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:07.603037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1b88375c-2557-4a07-94a0-61ee48916af7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1406 microversion: 2.20 time: 0.262807 Jul 14 11:14:07.603624 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 357/710] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:14:07 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:14:08.319417 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a3519af4-2af2-40e3-8cb0-4e556fe07676 req-b8eb951d-d595-4fe6-8722-e6ba6ab329d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2921e8-d6f6-4bcd-a5bd-a02da1353800", "name": "network-vif-deleted", "tag": "8f073a5b-cf77-4431-946c-0d8651ac7527"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:14:08.327780 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a3519af4-2af2-40e3-8cb0-4e556fe07676 req-b8eb951d-d595-4fe6-8722-e6ba6ab329d8 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:08.328215 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a3519af4-2af2-40e3-8cb0-4e556fe07676 req-b8eb951d-d595-4fe6-8722-e6ba6ab329d8 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:08.341876 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a3519af4-2af2-40e3-8cb0-4e556fe07676 req-b8eb951d-d595-4fe6-8722-e6ba6ab329d8 service nova] Creating event network-vif-deleted:8f073a5b-cf77-4431-946c-0d8651ac7527 for instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 on hv-cinder-84893 Jul 14 11:14:08.347710 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a3519af4-2af2-40e3-8cb0-4e556fe07676 req-b8eb951d-d595-4fe6-8722-e6ba6ab329d8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Jul 14 11:14:08.348510 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 354/711] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:14:08.608891 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:08.610161 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:08.620035 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:08.620884 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:08.622017 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:08.622966 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:08.624807 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:08.625741 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:08.633212 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:08.633841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:08.634973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:08.635541 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:08.664643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:08.665104 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:08.665564 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lazy-loading 'fault' on Instance uuid fe2921e8-d6f6-4bcd-a5bd-a02da1353800 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:14:08.724665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:08.733197 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-493491c8-22fe-4fab-9f36-270701e9d0c0 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 200 len: 1332 microversion: 2.1 time: 0.129536 Jul 14 11:14:08.733944 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 358/712] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:08 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 1332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:08.775414 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:08.784201 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:08.785710 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:08.786860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e610ac1-3f10-4416-928d-78ba40d6f298 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1599 microversion: 2.20 time: 0.168775 Jul 14 11:14:08.787447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 355/713] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:14:08 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:14:08.804623 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9fede561-f1bf-4b9a-a170-44944ecd54ba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:08.805112 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9fede561-f1bf-4b9a-a170-44944ecd54ba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:08.811249 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fede561-f1bf-4b9a-a170-44944ecd54ba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:08.811732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fede561-f1bf-4b9a-a170-44944ecd54ba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:08.812530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fede561-f1bf-4b9a-a170-44944ecd54ba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:08.812979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fede561-f1bf-4b9a-a170-44944ecd54ba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:08.896962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9fede561-f1bf-4b9a-a170-44944ecd54ba tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096390 Jul 14 11:14:08.897583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 359/714] 10.222.0.75 () {60 vars in 1315 bytes} [Thu Jul 14 11:14:08 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:14:09.750331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:09.750939 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: fe2921e8-d6f6-4bcd-a5bd-a02da1353800] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:09.757405 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:09.757853 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:09.758841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:09.759274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:09.772879 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] HTTP exception thrown: Instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 could not be found. Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Request method failure captured: Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 HTTP/1.1 Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jzy9h1Afs0zs0rg7mjGvgG2X2oacoD26dWlQUtf-FovaBrL9N0VLYZ7co154V9baVMH9pm0O_AMwefnkDNKFUvb3NMjRak-11YX1GGW-wLFw7qg6AZf1dPN_XPxFsfrvSfcSfka3MOyF0cOnn4UTDGmmi3OcXqllY1XqLLVKI1kew Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:14:09.774559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b3f043134a3d4369983f36769d2ae197", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: cb80e0c64c3348cfac5ad2c4f82fb606 Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 could not be found. Jul 14 11:14:09.776166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'fe2921e8-d6f6-4bcd-a5bd-a02da1353800'} Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 could not be found. Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:14:09.776943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 could not be found. Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 could not be found. Jul 14 11:14:09.778079 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:09.779097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Returning 404 to user: Instance fe2921e8-d6f6-4bcd-a5bd-a02da1353800 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:14:09.779097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-115b3616-7355-4c9c-8bd4-df1bda41d3c3 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800" status: 404 len: 111 microversion: 2.1 time: 0.029618 Jul 14 11:14:09.779097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 356/715] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:09 2022] GET /compute/v2.1/servers/fe2921e8-d6f6-4bcd-a5bd-a02da1353800 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:14:09.785995 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-962d51fb-01e4-444a-aaf6-36996951c953 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '.version_select at 0x7f579df491f0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:09.805552 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-962d51fb-01e4-444a-aaf6-36996951c953 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123089563" status: 202 len: 0 microversion: 2.1 time: 0.024308 Jul 14 11:14:09.806142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 360/716] 10.222.0.75 () {58 vars in 1217 bytes} [Thu Jul 14 11:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123089563 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:14:10.143623 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4a96b56e-6a82-4621-aa85-387fadb8c3a2 req-81bdc76d-7601-498a-8b2e-edd7031d9c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431", "tag": "6a60328d-ee1e-44d3-8008-6151b2c4427f"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:14:10.151718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4a96b56e-6a82-4621-aa85-387fadb8c3a2 req-81bdc76d-7601-498a-8b2e-edd7031d9c1b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:10.152163 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4a96b56e-6a82-4621-aa85-387fadb8c3a2 req-81bdc76d-7601-498a-8b2e-edd7031d9c1b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:10.163208 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4a96b56e-6a82-4621-aa85-387fadb8c3a2 req-81bdc76d-7601-498a-8b2e-edd7031d9c1b service nova] Creating event network-changed:6a60328d-ee1e-44d3-8008-6151b2c4427f for instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 on hv-cinder-84893 Jul 14 11:14:10.168112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4a96b56e-6a82-4621-aa85-387fadb8c3a2 req-81bdc76d-7601-498a-8b2e-edd7031d9c1b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092625 Jul 14 11:14:10.168928 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 357/717] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:14:12.100024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:14:12.100631 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:14:12.835635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6b5215a6-00ff-47c1-b0a5-65bf36b0d8a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:12.836140 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6b5215a6-00ff-47c1-b0a5-65bf36b0d8a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:12.842838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b5215a6-00ff-47c1-b0a5-65bf36b0d8a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:12.843292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b5215a6-00ff-47c1-b0a5-65bf36b0d8a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:12.844607 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b5215a6-00ff-47c1-b0a5-65bf36b0d8a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:12.845047 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b5215a6-00ff-47c1-b0a5-65bf36b0d8a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:12.872133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6b5215a6-00ff-47c1-b0a5-65bf36b0d8a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:14:12.956807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6b5215a6-00ff-47c1-b0a5-65bf36b0d8a4 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 204 len: 0 microversion: 2.1 time: 0.125258 Jul 14 11:14:12.957474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 361/718] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:14:12 2022] DELETE /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:14:12.967291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-12a6d2c4-2630-47d0-ace6-0efca080fee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:12.968028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-12a6d2c4-2630-47d0-ace6-0efca080fee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:12.974733 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12a6d2c4-2630-47d0-ace6-0efca080fee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:12.975178 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12a6d2c4-2630-47d0-ace6-0efca080fee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:12.976053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12a6d2c4-2630-47d0-ace6-0efca080fee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:12.976571 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12a6d2c4-2630-47d0-ace6-0efca080fee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:13.116738 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-12a6d2c4-2630-47d0-ace6-0efca080fee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:13.124218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-12a6d2c4-2630-47d0-ace6-0efca080fee1 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1506 microversion: 2.1 time: 0.162014 Jul 14 11:14:13.124716 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 358/719] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:12 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:14.141763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-313dd68c-c6a6-42c5-a1bb-6cf612dd254d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:14.142491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-313dd68c-c6a6-42c5-a1bb-6cf612dd254d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:14.149099 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-313dd68c-c6a6-42c5-a1bb-6cf612dd254d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:14.149557 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-313dd68c-c6a6-42c5-a1bb-6cf612dd254d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:14.150327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-313dd68c-c6a6-42c5-a1bb-6cf612dd254d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:14.150763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-313dd68c-c6a6-42c5-a1bb-6cf612dd254d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:14.314229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-313dd68c-c6a6-42c5-a1bb-6cf612dd254d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:14.321994 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-313dd68c-c6a6-42c5-a1bb-6cf612dd254d tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1506 microversion: 2.1 time: 0.184518 Jul 14 11:14:14.322863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 362/720] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:14 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:15.238500 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-dcdf709e-db60-4fc9-8148-111eecc14962 req-d7e40a54-a795-45b4-879b-078236e27c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd47a70-769e-4bfc-8954-376cd1d1dd8f", "name": "network-vif-deleted", "tag": "f17cb494-ce01-4f03-b511-25356a886eab"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:14:15.248416 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-dcdf709e-db60-4fc9-8148-111eecc14962 req-d7e40a54-a795-45b4-879b-078236e27c8c service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:15.248858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-dcdf709e-db60-4fc9-8148-111eecc14962 req-d7e40a54-a795-45b4-879b-078236e27c8c service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:15.262424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-dcdf709e-db60-4fc9-8148-111eecc14962 req-d7e40a54-a795-45b4-879b-078236e27c8c service nova] Creating event network-vif-deleted:f17cb494-ce01-4f03-b511-25356a886eab for instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f on hv-cinder-84893 Jul 14 11:14:15.268721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-dcdf709e-db60-4fc9-8148-111eecc14962 req-d7e40a54-a795-45b4-879b-078236e27c8c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033743 Jul 14 11:14:15.269431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 359/721] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:14:15.342050 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:15.342692 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:15.349517 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:15.349978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:15.350756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:15.351198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:15.356075 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:15.388070 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:15.388472 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:15.388910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lazy-loading 'fault' on Instance uuid 7dd47a70-769e-4bfc-8954-376cd1d1dd8f {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:14:15.433054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:15.441359 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8c2752a2-98ec-4ead-85be-9c681282b606 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 200 len: 1311 microversion: 2.1 time: 0.103181 Jul 14 11:14:15.441944 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 363/722] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:15 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:16.460017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:16.460710 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 7dd47a70-769e-4bfc-8954-376cd1d1dd8f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:16.467173 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:16.467658 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:16.468452 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:16.468872 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:16.482251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] HTTP exception thrown: Instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f could not be found. Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Request method failure captured: Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f HTTP/1.1 Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jzy9h1Afs0zs0rg7mjGvgG2X2oacoD26dWlQUtf-FovaBrL9N0VLYZ7co154V9baVMH9pm0O_AMwefnkDNKFUvb3NMjRak-11YX1GGW-wLFw7qg6AZf1dPN_XPxFsfrvSfcSfka3MOyF0cOnn4UTDGmmi3OcXqllY1XqLLVKI1kew Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:14:16.483889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b3f043134a3d4369983f36769d2ae197", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: cb80e0c64c3348cfac5ad2c4f82fb606 Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f could not be found. Jul 14 11:14:16.485143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '7dd47a70-769e-4bfc-8954-376cd1d1dd8f'} Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f could not be found. Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:14:16.485862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f could not be found. Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f could not be found. Jul 14 11:14:16.487254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:14:16.488473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Returning 404 to user: Instance 7dd47a70-769e-4bfc-8954-376cd1d1dd8f could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:14:16.488473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8782a797-9d02-441f-b690-cc18a31fa488 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f" status: 404 len: 111 microversion: 2.1 time: 0.030151 Jul 14 11:14:16.488473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 360/723] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:16 2022] GET /compute/v2.1/servers/7dd47a70-769e-4bfc-8954-376cd1d1dd8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:14:16.493926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8df3c9a0-e7df-4d0c-a6b7-fcd1140f2f43 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:16.494449 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8df3c9a0-e7df-4d0c-a6b7-fcd1140f2f43 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:16.496884 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:16.503661 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8df3c9a0-e7df-4d0c-a6b7-fcd1140f2f43 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:16.504110 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8df3c9a0-e7df-4d0c-a6b7-fcd1140f2f43 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:16.504873 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8df3c9a0-e7df-4d0c-a6b7-fcd1140f2f43 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:16.505344 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8df3c9a0-e7df-4d0c-a6b7-fcd1140f2f43 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:16.533579 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8df3c9a0-e7df-4d0c-a6b7-fcd1140f2f43 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:14:16.609930 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8df3c9a0-e7df-4d0c-a6b7-fcd1140f2f43 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 204 len: 0 microversion: 2.1 time: 0.119585 Jul 14 11:14:16.610896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 364/724] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:14:16 2022] DELETE /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:14:16.618760 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62b3c34b-5c2b-4183-85f2-0850ac34fa33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:16.619368 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62b3c34b-5c2b-4183-85f2-0850ac34fa33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:16.626169 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62b3c34b-5c2b-4183-85f2-0850ac34fa33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:16.626842 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62b3c34b-5c2b-4183-85f2-0850ac34fa33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:16.627640 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62b3c34b-5c2b-4183-85f2-0850ac34fa33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:16.628114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62b3c34b-5c2b-4183-85f2-0850ac34fa33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:16.767154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62b3c34b-5c2b-4183-85f2-0850ac34fa33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:16.770661 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:16.775593 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62b3c34b-5c2b-4183-85f2-0850ac34fa33 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.160746 Jul 14 11:14:16.776152 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 361/725] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:16 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:17.792236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8730432d-e2e0-4fc8-8114-f0cc2402cd08 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:17.792939 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8730432d-e2e0-4fc8-8114-f0cc2402cd08 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:17.799520 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8730432d-e2e0-4fc8-8114-f0cc2402cd08 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:17.799975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8730432d-e2e0-4fc8-8114-f0cc2402cd08 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:17.800744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8730432d-e2e0-4fc8-8114-f0cc2402cd08 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:17.801187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8730432d-e2e0-4fc8-8114-f0cc2402cd08 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:18.186132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8730432d-e2e0-4fc8-8114-f0cc2402cd08 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:18.194315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8730432d-e2e0-4fc8-8114-f0cc2402cd08 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.406290 Jul 14 11:14:18.194886 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 365/726] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:17 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:19.212830 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4d428140-015c-4893-bc3d-740aab468136 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:19.213603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4d428140-015c-4893-bc3d-740aab468136 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:19.215876 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:19.223117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d428140-015c-4893-bc3d-740aab468136 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:19.223611 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d428140-015c-4893-bc3d-740aab468136 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:19.224379 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d428140-015c-4893-bc3d-740aab468136 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:19.224810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d428140-015c-4893-bc3d-740aab468136 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:19.362820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4d428140-015c-4893-bc3d-740aab468136 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:19.370721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4d428140-015c-4893-bc3d-740aab468136 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1522 microversion: 2.1 time: 0.162322 Jul 14 11:14:19.371288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 362/727] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:19 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:20.276829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-898d84d8-07aa-456d-93a3-b09e8bd4cffe req-8ec58de9-5b87-44ef-9b24-1c177a4006e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb87b2e-2f5d-429a-95a9-1af62edd1e2b", "name": "network-vif-deleted", "tag": "13944c62-ebab-45c6-93d8-38bb5fd3a687"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:14:20.287866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-898d84d8-07aa-456d-93a3-b09e8bd4cffe req-8ec58de9-5b87-44ef-9b24-1c177a4006e8 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:20.288302 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-898d84d8-07aa-456d-93a3-b09e8bd4cffe req-8ec58de9-5b87-44ef-9b24-1c177a4006e8 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:20.304897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-898d84d8-07aa-456d-93a3-b09e8bd4cffe req-8ec58de9-5b87-44ef-9b24-1c177a4006e8 service nova] Creating event network-vif-deleted:13944c62-ebab-45c6-93d8-38bb5fd3a687 for instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b on hv-cinder-84893 Jul 14 11:14:20.311417 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-898d84d8-07aa-456d-93a3-b09e8bd4cffe req-8ec58de9-5b87-44ef-9b24-1c177a4006e8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039469 Jul 14 11:14:20.312152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 366/728] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:14:20.387467 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:20.388722 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:20.395989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:20.396446 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:20.397218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:20.397657 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:20.433286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:20.433741 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:20.434279 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lazy-loading 'fault' on Instance uuid 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:14:20.479404 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80e0c64c3348cfac5ad2c4f82fb606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f043134a3d4369983f36769d2ae197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:14:20.486970 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3c80616d-bb8a-4fd6-9da7-59f3731114a8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 200 len: 1312 microversion: 2.1 time: 0.103536 Jul 14 11:14:20.487572 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 363/729] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:20 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:14:21.504806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:21.505441 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] [instance: 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:14:21.511756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:21.512201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:21.512957 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:21.513387 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:21.529948 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] HTTP exception thrown: Instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b could not be found. Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Request method failure captured: Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b HTTP/1.1 Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_jzy9h1Afs0zs0rg7mjGvgG2X2oacoD26dWlQUtf-FovaBrL9N0VLYZ7co154V9baVMH9pm0O_AMwefnkDNKFUvb3NMjRak-11YX1GGW-wLFw7qg6AZf1dPN_XPxFsfrvSfcSfka3MOyF0cOnn4UTDGmmi3OcXqllY1XqLLVKI1kew Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:14:21.531610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b3f043134a3d4369983f36769d2ae197", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b3f043134a3d4369983f36769d2ae197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: b3f043134a3d4369983f36769d2ae197 Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-623709257 Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: cb80e0c64c3348cfac5ad2c4f82fb606 Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-ServerRescueNegativeTestJSON-623709257-project Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b could not be found. Jul 14 11:14:21.533633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '1bb87b2e-2f5d-429a-95a9-1af62edd1e2b'} Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b could not be found. Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:14:21.534383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b could not be found. Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b could not be found. Jul 14 11:14:21.535825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:14:21.537282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] Returning 404 to user: Instance 1bb87b2e-2f5d-429a-95a9-1af62edd1e2b could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:14:21.537282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7d647b41-d533-4dc1-ac2d-0715848981c8 tempest-ServerRescueNegativeTestJSON-623709257 tempest-ServerRescueNegativeTestJSON-623709257-project] 10.222.0.75 "GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b" status: 404 len: 111 microversion: 2.1 time: 0.034218 Jul 14 11:14:21.537282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 367/730] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:14:21 2022] GET /compute/v2.1/servers/1bb87b2e-2f5d-429a-95a9-1af62edd1e2b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:15:32.589778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=5 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:32.590533 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=14 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:32.595648 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1c13f90d-e2e4-44c2-8aa3-a887ffbb38fa tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:32.596670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1c13f90d-e2e4-44c2-8aa3-a887ffbb38fa tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:32.603764 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c13f90d-e2e4-44c2-8aa3-a887ffbb38fa tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:32.604215 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c13f90d-e2e4-44c2-8aa3-a887ffbb38fa tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:32.604989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c13f90d-e2e4-44c2-8aa3-a887ffbb38fa tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:32.605426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c13f90d-e2e4-44c2-8aa3-a887ffbb38fa tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:32.634398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1c13f90d-e2e4-44c2-8aa3-a887ffbb38fa tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046518 Jul 14 11:15:32.634957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 364/731] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:15:32 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:15:32.689898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:32.690632 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:32.695118 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-276ea9d0-e334-472f-aa6e-beee7618e5ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:32.695624 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-276ea9d0-e334-472f-aa6e-beee7618e5ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:32.703047 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-276ea9d0-e334-472f-aa6e-beee7618e5ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:32.703513 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-276ea9d0-e334-472f-aa6e-beee7618e5ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:32.704385 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-276ea9d0-e334-472f-aa6e-beee7618e5ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:32.704825 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-276ea9d0-e334-472f-aa6e-beee7618e5ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:32.731238 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-276ea9d0-e334-472f-aa6e-beee7618e5ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:15:32.805583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-276ea9d0-e334-472f-aa6e-beee7618e5ff tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 204 len: 0 microversion: 2.1 time: 0.117259 Jul 14 11:15:32.806360 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 368/732] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:15:32 2022] DELETE /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:15:32.814825 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2c9f4f54-c0ea-44ac-b7d6-d3dbd9f5ddb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:32.815456 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2c9f4f54-c0ea-44ac-b7d6-d3dbd9f5ddb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:32.822012 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c9f4f54-c0ea-44ac-b7d6-d3dbd9f5ddb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:32.822474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c9f4f54-c0ea-44ac-b7d6-d3dbd9f5ddb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:32.823871 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c9f4f54-c0ea-44ac-b7d6-d3dbd9f5ddb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:32.824304 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c9f4f54-c0ea-44ac-b7d6-d3dbd9f5ddb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:32.952313 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2c9f4f54-c0ea-44ac-b7d6-d3dbd9f5ddb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:32.959733 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2c9f4f54-c0ea-44ac-b7d6-d3dbd9f5ddb0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1670 microversion: 2.1 time: 0.149062 Jul 14 11:15:32.960297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 365/733] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:32 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:33.978324 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ea689dc3-6c87-44a6-aabc-9d37c591a94b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:33.979032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ea689dc3-6c87-44a6-aabc-9d37c591a94b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:33.986231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea689dc3-6c87-44a6-aabc-9d37c591a94b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:33.986686 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea689dc3-6c87-44a6-aabc-9d37c591a94b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:33.987507 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea689dc3-6c87-44a6-aabc-9d37c591a94b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:33.987968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea689dc3-6c87-44a6-aabc-9d37c591a94b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:34.137941 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ea689dc3-6c87-44a6-aabc-9d37c591a94b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:34.145580 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ea689dc3-6c87-44a6-aabc-9d37c591a94b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1670 microversion: 2.1 time: 0.172114 Jul 14 11:15:34.146184 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 369/734] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:33 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:34.417630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3cd1332a-1048-4128-8fdf-81f163774d01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:34.418182 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3cd1332a-1048-4128-8fdf-81f163774d01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:34.425105 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3cd1332a-1048-4128-8fdf-81f163774d01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:34.425549 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3cd1332a-1048-4128-8fdf-81f163774d01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:34.426318 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3cd1332a-1048-4128-8fdf-81f163774d01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:34.426803 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3cd1332a-1048-4128-8fdf-81f163774d01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:34.450776 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3cd1332a-1048-4128-8fdf-81f163774d01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/ips" status: 200 len: 151 microversion: 2.1 time: 0.036921 Jul 14 11:15:34.451352 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 366/735] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:15:34 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:35.136708 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-dfc4568a-84d1-4fb3-9a71-a0c96f85a432 req-b61557cc-a13d-475d-95ce-28cef7ac3f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa194f91-d8c4-46f8-bbef-593b0e0fb64d", "name": "network-vif-deleted", "tag": "96ec0c47-759f-4fc1-a1f6-482d3b2353f6"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:35.148938 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-dfc4568a-84d1-4fb3-9a71-a0c96f85a432 req-b61557cc-a13d-475d-95ce-28cef7ac3f02 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:35.149453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-dfc4568a-84d1-4fb3-9a71-a0c96f85a432 req-b61557cc-a13d-475d-95ce-28cef7ac3f02 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:35.163057 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-dfc4568a-84d1-4fb3-9a71-a0c96f85a432 req-b61557cc-a13d-475d-95ce-28cef7ac3f02 service nova] Creating event network-vif-deleted:96ec0c47-759f-4fc1-a1f6-482d3b2353f6 for instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d on hv-cinder-84893 Jul 14 11:15:35.167523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3d5785d8-5971-47f4-9217-21f704806e5e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:35.168217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-dfc4568a-84d1-4fb3-9a71-a0c96f85a432 req-b61557cc-a13d-475d-95ce-28cef7ac3f02 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035237 Jul 14 11:15:35.170964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3d5785d8-5971-47f4-9217-21f704806e5e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:35.171822 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 370/736] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:35.182522 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d5785d8-5971-47f4-9217-21f704806e5e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:35.184947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d5785d8-5971-47f4-9217-21f704806e5e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:35.185829 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d5785d8-5971-47f4-9217-21f704806e5e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:35.190774 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d5785d8-5971-47f4-9217-21f704806e5e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:35.270015 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d5785d8-5971-47f4-9217-21f704806e5e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:35.279905 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3d5785d8-5971-47f4-9217-21f704806e5e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 200 len: 1322 microversion: 2.1 time: 0.120217 Jul 14 11:15:35.281086 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 367/737] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:35 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 1322 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:35.792986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0bff2bb0-0605-4bdb-9392-0473559f90fd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85febeec-e18d-47ae-93eb-a264b2be516b"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:35.794239 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0bff2bb0-0605-4bdb-9392-0473559f90fd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:35.800524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bff2bb0-0605-4bdb-9392-0473559f90fd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:35.800982 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bff2bb0-0605-4bdb-9392-0473559f90fd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:35.802261 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bff2bb0-0605-4bdb-9392-0473559f90fd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:35.802699 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bff2bb0-0605-4bdb-9392-0473559f90fd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:36.144763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0bff2bb0-0605-4bdb-9392-0473559f90fd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355881 Jul 14 11:15:36.150076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 371/738] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:15:35 2022] POST /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:36.296989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:36.297580 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:36.304820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:36.305266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:36.306018 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:36.306442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:36.319881 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] HTTP exception thrown: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Request method failure captured: Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d HTTP/1.1 Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_lyHKVyWpGESY9FMlsaOM8Xwie7_39taeBITeldUgAbWsiNuUknZySmYwjpXSIBapN6utcWksfwe07fbRNd56-ENzNdfHzffMLw3x1Y5ZOZ3yEW7x2MGzhyKe1wMKOdH2AfXengnUoiFh3pb_quV0uU3OgMo-txDYGDBkVCCGjvGWM Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:15:36.321402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a7cf89df79d64153a73a5ec4d49f376f", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 5a7c1a5f674c4dfbb969ac37c5102408 Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:15:36.322969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'aa194f91-d8c4-46f8-bbef-593b0e0fb64d'} Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:15:36.324109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:15:36.325731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:15:36.327262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Returning 404 to user: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:15:36.327262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7de9291d-f2a8-4ed2-86b2-879350851d4f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 404 len: 111 microversion: 2.1 time: 0.029664 Jul 14 11:15:36.327262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 368/739] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:36 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:15:36.332768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9e05c3e2-a89e-4f6c-85f8-dd023a7732f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '.version_select at 0x7f579df8df70>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:36.359805 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9e05c3e2-a89e-4f6c-85f8-dd023a7732f6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644376790" status: 202 len: 0 microversion: 2.1 time: 0.031672 Jul 14 11:15:36.360695 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 372/740] 10.222.0.75 () {58 vars in 1220 bytes} [Thu Jul 14 11:15:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644376790 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:15:36.980787 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fd0e9afc-8275-432b-9669-f494414c3db8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'create', calling method: .version_select at 0x7f579def1f70>, body: {"keypair": {"name": "tempest-keypair-178470685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPPbtBvbojju42oPaGuJ3U3C5e3u8UrzdllymrZ0bnxIJUFnMGfiyKBc+oANbxQ9hxZg9ALZ/xk5LZxSuO/HmMoBf4KoEHRmnWqxUi6yGa+iSQyywtYJCl4of+tTKytdg=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:36.995109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-fd0e9afc-8275-432b-9669-f494414c3db8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Getting quotas for project a7cf89df79d64153a73a5ec4d49f376f. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:15:36.998873 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-fd0e9afc-8275-432b-9669-f494414c3db8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Getting quotas for user 5a7c1a5f674c4dfbb969ac37c5102408 and project a7cf89df79d64153a73a5ec4d49f376f. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:15:37.020763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fd0e9afc-8275-432b-9669-f494414c3db8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043839 Jul 14 11:15:37.021352 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 369/741] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:15:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:38.198450 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-996907794", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8eaca00-9ce0-454f-9fb3-291577542b1d"}], "security_groups": [{"name": "tempest-securitygroup--654820789"}], "key_name": "tempest-keypair-178470685", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:38.314510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] validate_networks() for [('d8eaca00-9ce0-454f-9fb3-291577542b1d', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:15:38.791801 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:15:38.792218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:15:38.792685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:15:38.793086 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:15:38.793492 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:15:38.803039 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:38.803523 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:38.804311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:38.804743 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:38.822243 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Getting quotas for project a7cf89df79d64153a73a5ec4d49f376f. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:15:38.826161 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Getting quotas for user 5a7c1a5f674c4dfbb969ac37c5102408 and project a7cf89df79d64153a73a5ec4d49f376f. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:15:38.837398 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:15:38.839748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:15:38.890866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ab50fcfb-2d12-4c06-853d-a9bc8781c932 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.696643 Jul 14 11:15:38.891544 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 373/742] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:15:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:15:38.902409 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-751b9dd5-51e4-419e-9a9e-8df93e7ee113 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:38.903016 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-751b9dd5-51e4-419e-9a9e-8df93e7ee113 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:38.956596 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-751b9dd5-51e4-419e-9a9e-8df93e7ee113 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:38.963840 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-751b9dd5-51e4-419e-9a9e-8df93e7ee113 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1236 microversion: 2.1 time: 0.065713 Jul 14 11:15:38.964411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 370/743] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:38 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:39.981218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-19dc13fa-7d58-4b08-a3e3-bcd442895887 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:39.981830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-19dc13fa-7d58-4b08-a3e3-bcd442895887 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:40.037896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-19dc13fa-7d58-4b08-a3e3-bcd442895887 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:40.045193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-19dc13fa-7d58-4b08-a3e3-bcd442895887 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1236 microversion: 2.1 time: 0.068329 Jul 14 11:15:40.045747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 374/744] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:39 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:41.062376 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-033e4604-2cdb-4dc7-81fb-ff6730d8107c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:41.062893 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-033e4604-2cdb-4dc7-81fb-ff6730d8107c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:41.117941 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-033e4604-2cdb-4dc7-81fb-ff6730d8107c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:41.125163 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-033e4604-2cdb-4dc7-81fb-ff6730d8107c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1236 microversion: 2.1 time: 0.066821 Jul 14 11:15:41.125732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 371/745] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:41 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:42.142062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b72b136e-1f9c-47a7-a99b-f04552a9944b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:42.142667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b72b136e-1f9c-47a7-a99b-f04552a9944b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:42.196402 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b72b136e-1f9c-47a7-a99b-f04552a9944b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:42.203491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b72b136e-1f9c-47a7-a99b-f04552a9944b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1236 microversion: 2.1 time: 0.065271 Jul 14 11:15:42.204053 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 375/746] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:42 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:43.220440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2f10b40d-77a8-4233-84bc-9fb1e2eaaca9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:43.221048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2f10b40d-77a8-4233-84bc-9fb1e2eaaca9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:43.228218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f10b40d-77a8-4233-84bc-9fb1e2eaaca9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:43.228672 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f10b40d-77a8-4233-84bc-9fb1e2eaaca9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:43.229433 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f10b40d-77a8-4233-84bc-9fb1e2eaaca9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:43.229868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f10b40d-77a8-4233-84bc-9fb1e2eaaca9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:43.292661 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f10b40d-77a8-4233-84bc-9fb1e2eaaca9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:43.300548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2f10b40d-77a8-4233-84bc-9fb1e2eaaca9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1240 microversion: 2.1 time: 0.083736 Jul 14 11:15:43.300893 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 372/747] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:43 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:43.662281 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85febeec-e18d-47ae-93eb-a264b2be516b"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:43.663455 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:43.670717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:43.671171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:43.671978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:43.672420 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:43.760401 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Invalid volume: volume 85febeec-e18d-47ae-93eb-a264b2be516b is already attached to instances: d5638369-b1e6-4b47-a77e-1e875bac6038 Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: POST /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments HTTP/1.1 Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 74 Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:15:43.762133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {"volumeAttachment": {"volumeId": "85febeec-e18d-47ae-93eb-a264b2be516b"}} Jul 14 11:15:43.763790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Invalid volume: volume 85febeec-e18d-47ae-93eb-a264b2be516b is already attached to instances: d5638369-b1e6-4b47-a77e-1e875bac6038 Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'server_id': 'd5638369-b1e6-4b47-a77e-1e875bac6038', 'body': {'volumeAttachment': {'volumeId': '85febeec-e18d-47ae-93eb-a264b2be516b'}}} Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 85febeec-e18d-47ae-93eb-a264b2be516b is already attached to instances: d5638369-b1e6-4b47-a77e-1e875bac6038 Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:43.765413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 85febeec-e18d-47ae-93eb-a264b2be516b is already attached to instances: d5638369-b1e6-4b47-a77e-1e875bac6038 Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:43.766776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:15:43.768220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:15:43.768220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:15:43.768220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:15:43.768220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 85febeec-e18d-47ae-93eb-a264b2be516b is already attached to instances: d5638369-b1e6-4b47-a77e-1e875bac6038 Jul 14 11:15:43.768220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:43.768220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 400 to user: Invalid volume: volume 85febeec-e18d-47ae-93eb-a264b2be516b is already attached to instances: d5638369-b1e6-4b47-a77e-1e875bac6038 {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:15:43.768220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-087190a8-d877-4b8a-a18d-6fd4274edd70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105451 Jul 14 11:15:43.768220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 376/748] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:15:43 2022] POST /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:15:43.827091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d75fabb0-5a5a-40c1-b76c-d3ba22fc8bc3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:43.827614 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d75fabb0-5a5a-40c1-b76c-d3ba22fc8bc3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:43.834527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d75fabb0-5a5a-40c1-b76c-d3ba22fc8bc3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:43.834967 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d75fabb0-5a5a-40c1-b76c-d3ba22fc8bc3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:43.835778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d75fabb0-5a5a-40c1-b76c-d3ba22fc8bc3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:43.836192 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d75fabb0-5a5a-40c1-b76c-d3ba22fc8bc3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:43.919494 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-d75fabb0-5a5a-40c1-b76c-d3ba22fc8bc3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lazy-loading 'services' on Instance uuid d5638369-b1e6-4b47-a77e-1e875bac6038 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:15:44.002274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d75fabb0-5a5a-40c1-b76c-d3ba22fc8bc3 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments/85febeec-e18d-47ae-93eb-a264b2be516b" status: 202 len: 0 microversion: 2.1 time: 0.178833 Jul 14 11:15:44.014217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-356ce4cf-d98b-4358-a8d5-4b87929570de tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:44.014685 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 373/749] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:15:43 2022] DELETE /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments/85febeec-e18d-47ae-93eb-a264b2be516b => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:15:44.015269 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-356ce4cf-d98b-4358-a8d5-4b87929570de tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:44.029067 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-356ce4cf-d98b-4358-a8d5-4b87929570de tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:44.029837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-356ce4cf-d98b-4358-a8d5-4b87929570de tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:44.032729 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-356ce4cf-d98b-4358-a8d5-4b87929570de tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:44.035667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-356ce4cf-d98b-4358-a8d5-4b87929570de tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:44.072201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-356ce4cf-d98b-4358-a8d5-4b87929570de tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062520 Jul 14 11:15:44.072806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 377/750] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:15:44 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:15:44.319429 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b7bcba83-a71d-4e38-915c-250587b68b5d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:44.320041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b7bcba83-a71d-4e38-915c-250587b68b5d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:44.326424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7bcba83-a71d-4e38-915c-250587b68b5d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:44.326871 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7bcba83-a71d-4e38-915c-250587b68b5d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:44.327670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7bcba83-a71d-4e38-915c-250587b68b5d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:44.328108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7bcba83-a71d-4e38-915c-250587b68b5d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:44.391624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b7bcba83-a71d-4e38-915c-250587b68b5d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:44.399788 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b7bcba83-a71d-4e38-915c-250587b68b5d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1294 microversion: 2.1 time: 0.085186 Jul 14 11:15:44.400367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 374/751] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:44 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:45.085901 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-21a19433-ad07-4057-98c0-6f7ba10b914b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:45.088129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-21a19433-ad07-4057-98c0-6f7ba10b914b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:45.097855 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21a19433-ad07-4057-98c0-6f7ba10b914b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:45.098346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21a19433-ad07-4057-98c0-6f7ba10b914b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:45.099304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21a19433-ad07-4057-98c0-6f7ba10b914b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:45.099815 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21a19433-ad07-4057-98c0-6f7ba10b914b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:45.129365 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-21a19433-ad07-4057-98c0-6f7ba10b914b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048377 Jul 14 11:15:45.130588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 378/752] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:15:45 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:15:45.190255 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0ce419ff-d439-4819-8382-5bf30b660346 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:45.190995 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0ce419ff-d439-4819-8382-5bf30b660346 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:45.199083 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ce419ff-d439-4819-8382-5bf30b660346 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:45.199754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ce419ff-d439-4819-8382-5bf30b660346 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:45.200580 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ce419ff-d439-4819-8382-5bf30b660346 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:45.201162 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ce419ff-d439-4819-8382-5bf30b660346 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:45.228832 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0ce419ff-d439-4819-8382-5bf30b660346 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:15:45.318950 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0ce419ff-d439-4819-8382-5bf30b660346 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 204 len: 0 microversion: 2.1 time: 0.132215 Jul 14 11:15:45.319751 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 375/753] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:15:45 2022] DELETE /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:15:45.328485 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7eb197f0-232a-41e2-a629-817505f4b499 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:45.329120 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7eb197f0-232a-41e2-a629-817505f4b499 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:45.336394 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7eb197f0-232a-41e2-a629-817505f4b499 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:45.336842 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7eb197f0-232a-41e2-a629-817505f4b499 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:45.337614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7eb197f0-232a-41e2-a629-817505f4b499 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:45.338045 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7eb197f0-232a-41e2-a629-817505f4b499 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:45.418087 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3df7773a-4683-4395-9099-089cf98c708b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:45.418808 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3df7773a-4683-4395-9099-089cf98c708b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:45.425943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3df7773a-4683-4395-9099-089cf98c708b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:45.427218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3df7773a-4683-4395-9099-089cf98c708b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:45.428415 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3df7773a-4683-4395-9099-089cf98c708b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:45.428851 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3df7773a-4683-4395-9099-089cf98c708b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:45.488634 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7eb197f0-232a-41e2-a629-817505f4b499 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:45.498311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7eb197f0-232a-41e2-a629-817505f4b499 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1683 microversion: 2.1 time: 0.174033 Jul 14 11:15:45.499468 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 379/754] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:45 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:45.567244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3df7773a-4683-4395-9099-089cf98c708b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:45.575018 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3df7773a-4683-4395-9099-089cf98c708b tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1361 microversion: 2.1 time: 0.161237 Jul 14 11:15:45.575629 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 376/755] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:45 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:15:46.515556 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8f84f2e6-1233-4541-bc7a-46b3e4b70319 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:46.516117 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8f84f2e6-1233-4541-bc7a-46b3e4b70319 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:46.522710 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f84f2e6-1233-4541-bc7a-46b3e4b70319 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:46.523162 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f84f2e6-1233-4541-bc7a-46b3e4b70319 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:46.523957 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f84f2e6-1233-4541-bc7a-46b3e4b70319 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:46.524398 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f84f2e6-1233-4541-bc7a-46b3e4b70319 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:46.592685 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6698fe6e-9f7b-42cd-9a11-fdb69d15fe97 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:46.593378 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6698fe6e-9f7b-42cd-9a11-fdb69d15fe97 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:46.602566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6698fe6e-9f7b-42cd-9a11-fdb69d15fe97 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:46.603058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6698fe6e-9f7b-42cd-9a11-fdb69d15fe97 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:46.603942 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6698fe6e-9f7b-42cd-9a11-fdb69d15fe97 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:46.604374 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6698fe6e-9f7b-42cd-9a11-fdb69d15fe97 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:46.724779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8f84f2e6-1233-4541-bc7a-46b3e4b70319 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:46.733430 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8f84f2e6-1233-4541-bc7a-46b3e4b70319 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1683 microversion: 2.1 time: 0.221830 Jul 14 11:15:46.734402 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 380/756] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:46 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1683 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:46.743659 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6698fe6e-9f7b-42cd-9a11-fdb69d15fe97 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:46.752012 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6698fe6e-9f7b-42cd-9a11-fdb69d15fe97 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1361 microversion: 2.1 time: 0.163109 Jul 14 11:15:46.752612 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 377/757] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:46 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:15:47.230008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-dbaf113e-fb5e-4f7b-a797-c232d323fe0f req-bad144f3-3aa6-4d6b-84b2-69b266094625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e926c16d-12f3-4547-a52f-5056741e44a3", "tag": "98da6298-514b-49c8-9c95-10d67d8b606e"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:47.239702 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-dbaf113e-fb5e-4f7b-a797-c232d323fe0f req-bad144f3-3aa6-4d6b-84b2-69b266094625 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:47.240492 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-dbaf113e-fb5e-4f7b-a797-c232d323fe0f req-bad144f3-3aa6-4d6b-84b2-69b266094625 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:47.255164 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-dbaf113e-fb5e-4f7b-a797-c232d323fe0f req-bad144f3-3aa6-4d6b-84b2-69b266094625 service nova] Creating event network-changed:98da6298-514b-49c8-9c95-10d67d8b606e for instance e926c16d-12f3-4547-a52f-5056741e44a3 on hv-cinder-84893 Jul 14 11:15:47.260985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-dbaf113e-fb5e-4f7b-a797-c232d323fe0f req-bad144f3-3aa6-4d6b-84b2-69b266094625 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034630 Jul 14 11:15:47.262256 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 381/758] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:15:47.750606 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6e6ca4dc-eeef-4363-a5c0-e4ca6dc6989c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:47.751160 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6e6ca4dc-eeef-4363-a5c0-e4ca6dc6989c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:47.758388 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e6ca4dc-eeef-4363-a5c0-e4ca6dc6989c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:47.758837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e6ca4dc-eeef-4363-a5c0-e4ca6dc6989c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:47.759632 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e6ca4dc-eeef-4363-a5c0-e4ca6dc6989c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:47.760150 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e6ca4dc-eeef-4363-a5c0-e4ca6dc6989c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:47.771561 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-30ef777f-45a8-4245-a565-8f9b0ab248c0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:47.773004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-30ef777f-45a8-4245-a565-8f9b0ab248c0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:47.780579 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-30ef777f-45a8-4245-a565-8f9b0ab248c0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:47.781122 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-30ef777f-45a8-4245-a565-8f9b0ab248c0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:47.781978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-30ef777f-45a8-4245-a565-8f9b0ab248c0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:47.782648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-30ef777f-45a8-4245-a565-8f9b0ab248c0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:47.895687 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6e6ca4dc-eeef-4363-a5c0-e4ca6dc6989c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:47.903408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6e6ca4dc-eeef-4363-a5c0-e4ca6dc6989c tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1683 microversion: 2.1 time: 0.156634 Jul 14 11:15:47.903911 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 378/759] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:47 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:48.118979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-30ef777f-45a8-4245-a565-8f9b0ab248c0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:48.126502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-30ef777f-45a8-4245-a565-8f9b0ab248c0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1361 microversion: 2.1 time: 0.362030 Jul 14 11:15:48.127120 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 382/760] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:47 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:15:48.920855 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3a9fd21-9544-4e71-9150-a02ede3811c6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:48.921517 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3a9fd21-9544-4e71-9150-a02ede3811c6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:48.928412 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3a9fd21-9544-4e71-9150-a02ede3811c6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:48.928865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3a9fd21-9544-4e71-9150-a02ede3811c6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:48.929624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3a9fd21-9544-4e71-9150-a02ede3811c6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:48.930053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3a9fd21-9544-4e71-9150-a02ede3811c6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:48.992486 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3a9fd21-9544-4e71-9150-a02ede3811c6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:48.999771 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3a9fd21-9544-4e71-9150-a02ede3811c6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1615 microversion: 2.1 time: 0.082760 Jul 14 11:15:49.000676 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 379/761] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:48 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:49.144303 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fed701fc-1c6a-446a-917d-ffa5cfe3d0b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:49.145647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fed701fc-1c6a-446a-917d-ffa5cfe3d0b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:49.148094 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:49.153621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fed701fc-1c6a-446a-917d-ffa5cfe3d0b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:49.154154 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fed701fc-1c6a-446a-917d-ffa5cfe3d0b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:49.154858 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fed701fc-1c6a-446a-917d-ffa5cfe3d0b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:49.155300 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fed701fc-1c6a-446a-917d-ffa5cfe3d0b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:49.292434 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-706ba009-b383-4e01-9885-979d35c053f5 req-d55ffad4-0ad9-48a5-ad53-aa970123bb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5638369-b1e6-4b47-a77e-1e875bac6038", "name": "network-vif-deleted", "tag": "1d18c91d-ab99-42c3-b298-881ad82fb9fa"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:49.298333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fed701fc-1c6a-446a-917d-ffa5cfe3d0b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:49.300840 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-706ba009-b383-4e01-9885-979d35c053f5 req-d55ffad4-0ad9-48a5-ad53-aa970123bb2d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:49.302270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-706ba009-b383-4e01-9885-979d35c053f5 req-d55ffad4-0ad9-48a5-ad53-aa970123bb2d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:49.306530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fed701fc-1c6a-446a-917d-ffa5cfe3d0b0 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1361 microversion: 2.1 time: 0.166156 Jul 14 11:15:49.307097 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 383/762] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:49 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:49.313138 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-706ba009-b383-4e01-9885-979d35c053f5 req-d55ffad4-0ad9-48a5-ad53-aa970123bb2d service nova] Creating event network-vif-deleted:1d18c91d-ab99-42c3-b298-881ad82fb9fa for instance d5638369-b1e6-4b47-a77e-1e875bac6038 on hv-cinder-84893 Jul 14 11:15:49.318877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-706ba009-b383-4e01-9885-979d35c053f5 req-d55ffad4-0ad9-48a5-ad53-aa970123bb2d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030180 Jul 14 11:15:49.319494 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 380/763] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:15:50.017327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6f4017a6-f7bf-4e35-a599-a8556ac7fd71 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:50.017960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6f4017a6-f7bf-4e35-a599-a8556ac7fd71 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:50.024025 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6f4017a6-f7bf-4e35-a599-a8556ac7fd71 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:50.024471 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6f4017a6-f7bf-4e35-a599-a8556ac7fd71 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:50.025229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6f4017a6-f7bf-4e35-a599-a8556ac7fd71 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:50.025665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6f4017a6-f7bf-4e35-a599-a8556ac7fd71 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:50.090898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6f4017a6-f7bf-4e35-a599-a8556ac7fd71 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:50.101594 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6f4017a6-f7bf-4e35-a599-a8556ac7fd71 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1615 microversion: 2.1 time: 0.088058 Jul 14 11:15:50.102176 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 384/764] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:50 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:50.324772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-476ec183-0f74-424a-98ad-1d3c7a96415e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:50.325474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-476ec183-0f74-424a-98ad-1d3c7a96415e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:50.331725 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-476ec183-0f74-424a-98ad-1d3c7a96415e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:50.332175 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-476ec183-0f74-424a-98ad-1d3c7a96415e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:50.333440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-476ec183-0f74-424a-98ad-1d3c7a96415e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:50.333872 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-476ec183-0f74-424a-98ad-1d3c7a96415e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:50.480924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-476ec183-0f74-424a-98ad-1d3c7a96415e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:50.488688 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-476ec183-0f74-424a-98ad-1d3c7a96415e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1361 microversion: 2.1 time: 0.168566 Jul 14 11:15:50.489279 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 381/765] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:50 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:51.118456 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:51.119175 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:51.125664 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:51.126119 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:51.126906 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:51.127376 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:51.167069 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:51.167557 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:51.168024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lazy-loading 'fault' on Instance uuid d5638369-b1e6-4b47-a77e-1e875bac6038 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:15:51.212421 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:51.219820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1ce318d6-4408-4a33-a388-1aad0822a2d5 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 200 len: 1331 microversion: 2.1 time: 0.105415 Jul 14 11:15:51.220542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 385/766] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:51 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:51.506056 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-51dd9725-0a77-49d0-84a8-7ec2ebb4b6f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:51.506671 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-51dd9725-0a77-49d0-84a8-7ec2ebb4b6f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:51.508862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=8 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:51.514393 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-51dd9725-0a77-49d0-84a8-7ec2ebb4b6f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:51.514843 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-51dd9725-0a77-49d0-84a8-7ec2ebb4b6f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:51.515644 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-51dd9725-0a77-49d0-84a8-7ec2ebb4b6f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:51.516081 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-51dd9725-0a77-49d0-84a8-7ec2ebb4b6f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:51.647841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-51dd9725-0a77-49d0-84a8-7ec2ebb4b6f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:51.651255 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:51.656081 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-51dd9725-0a77-49d0-84a8-7ec2ebb4b6f9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1361 microversion: 2.1 time: 0.154361 Jul 14 11:15:51.656656 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 382/767] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:51 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:52.237572 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:52.238213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:52.240529 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=10 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:52.246227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:52.246677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:52.247477 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:52.247944 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:52.251984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:52.263224 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 HTTP/1.1 Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:15:52.265054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:15:52.266647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'd5638369-b1e6-4b47-a77e-1e875bac6038'} Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:15:52.267491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:15:52.268903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:15:52.270771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:15:52.270771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fad0123a-f717-4b97-abb0-0326a1111ab4 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 404 len: 111 microversion: 2.1 time: 0.032875 Jul 14 11:15:52.270771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 386/768] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:52 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:15:52.276049 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f62da956-510b-4891-82be-1d13ce1348ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '.version_select at 0x7f579de45430>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:52.295574 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f62da956-510b-4891-82be-1d13ce1348ca tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664589474" status: 202 len: 0 microversion: 2.1 time: 0.023295 Jul 14 11:15:52.296160 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 383/769] 10.222.0.75 () {58 vars in 1217 bytes} [Thu Jul 14 11:15:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664589474 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:15:52.529810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-cebbe9ed-1892-4d37-9e60-c21d46c668e8 req-bc7c19ab-3602-4a5f-8ddf-b588d8fa7821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e926c16d-12f3-4547-a52f-5056741e44a3", "name": "network-vif-plugged", "status": "completed", "tag": "98da6298-514b-49c8-9c95-10d67d8b606e"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:52.539843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-cebbe9ed-1892-4d37-9e60-c21d46c668e8 req-bc7c19ab-3602-4a5f-8ddf-b588d8fa7821 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:52.540292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-cebbe9ed-1892-4d37-9e60-c21d46c668e8 req-bc7c19ab-3602-4a5f-8ddf-b588d8fa7821 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:52.554007 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-cebbe9ed-1892-4d37-9e60-c21d46c668e8 req-bc7c19ab-3602-4a5f-8ddf-b588d8fa7821 service nova] Creating event network-vif-plugged:98da6298-514b-49c8-9c95-10d67d8b606e for instance e926c16d-12f3-4547-a52f-5056741e44a3 on hv-cinder-84893 Jul 14 11:15:52.560003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-cebbe9ed-1892-4d37-9e60-c21d46c668e8 req-bc7c19ab-3602-4a5f-8ddf-b588d8fa7821 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034725 Jul 14 11:15:52.560953 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 387/770] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:15:52.675419 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-84038d44-25ed-4f13-8902-16eb58664dce tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:52.676720 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-84038d44-25ed-4f13-8902-16eb58664dce tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:52.686569 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84038d44-25ed-4f13-8902-16eb58664dce tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:52.687674 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84038d44-25ed-4f13-8902-16eb58664dce tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:52.689135 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84038d44-25ed-4f13-8902-16eb58664dce tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:52.689931 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84038d44-25ed-4f13-8902-16eb58664dce tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:52.831251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-84038d44-25ed-4f13-8902-16eb58664dce tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:52.839710 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-84038d44-25ed-4f13-8902-16eb58664dce tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1361 microversion: 2.1 time: 0.169686 Jul 14 11:15:52.840434 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 384/771] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:52 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:52.985213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0ddfdb82-c247-4414-903e-1708516e50c8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: .version_select at 0x7f579de6cd30>, body: {"keypair": {"name": "tempest-keypair-1601687212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJOZ2H+w5B4F1NPGBLoSmGP9QLsMPskmdLVP64BQzrdo8LxqgubGO9AI6UPo0mjnwzKVUNfFgCSqFYrsQ3wBCy/4HpkZBokwaw1gWGhHF1i8a1cOTQ2AWpTIdof/rZEYg=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:53.001005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-0ddfdb82-c247-4414-903e-1708516e50c8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for project 7f04452d94114c64b9882cfa66e29479. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:15:53.004991 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-0ddfdb82-c247-4414-903e-1708516e50c8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for user fffbf852ddc9455f8a68f80ad118e4d1 and project 7f04452d94114c64b9882cfa66e29479. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:15:53.027694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0ddfdb82-c247-4414-903e-1708516e50c8 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046587 Jul 14 11:15:53.028218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 388/772] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:15:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:53.857916 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c665ec93-74dd-44fb-9b89-5f13d81a52a4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:53.858519 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c665ec93-74dd-44fb-9b89-5f13d81a52a4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:53.865672 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c665ec93-74dd-44fb-9b89-5f13d81a52a4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:53.866115 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c665ec93-74dd-44fb-9b89-5f13d81a52a4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:53.866883 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c665ec93-74dd-44fb-9b89-5f13d81a52a4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:53.867576 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c665ec93-74dd-44fb-9b89-5f13d81a52a4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:54.009134 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c665ec93-74dd-44fb-9b89-5f13d81a52a4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:54.018051 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c665ec93-74dd-44fb-9b89-5f13d81a52a4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1361 microversion: 2.1 time: 0.163955 Jul 14 11:15:54.018731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 385/773] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:53 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:54.298886 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1232965264", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e745ada-d5b0-42ea-a509-ecc280f4f780"}], "security_groups": [{"name": "tempest-securitygroup--954989999"}], "key_name": "tempest-keypair-1601687212", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:54.402641 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] validate_networks() for [('9e745ada-d5b0-42ea-a509-ecc280f4f780', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:15:54.777632 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:15:54.778053 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:15:54.778524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:15:54.778931 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:15:54.779887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:15:54.789797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:54.790249 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:54.791054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:54.791525 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:54.809614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for project 7f04452d94114c64b9882cfa66e29479. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:15:54.813658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Getting quotas for user fffbf852ddc9455f8a68f80ad118e4d1 and project 7f04452d94114c64b9882cfa66e29479. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:15:54.826279 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:15:54.828713 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:15:54.856583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:54.878353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c8942df2-b51f-4e16-abc5-585430448441 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.584193 Jul 14 11:15:54.879209 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 389/774] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:15:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:15:54.889506 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2c18ebb4-ce70-4c48-8938-2dbda9dedfe9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:54.890195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2c18ebb4-ce70-4c48-8938-2dbda9dedfe9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:54.949822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2c18ebb4-ce70-4c48-8938-2dbda9dedfe9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:54.956762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2c18ebb4-ce70-4c48-8938-2dbda9dedfe9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1242 microversion: 2.1 time: 0.071398 Jul 14 11:15:54.957335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 386/775] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:54 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:55.035495 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8f44b9ef-98cd-41a9-b765-d4ca1019b08e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:55.036330 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8f44b9ef-98cd-41a9-b765-d4ca1019b08e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:55.044890 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f44b9ef-98cd-41a9-b765-d4ca1019b08e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:55.045346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f44b9ef-98cd-41a9-b765-d4ca1019b08e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:55.046126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f44b9ef-98cd-41a9-b765-d4ca1019b08e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:55.046568 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f44b9ef-98cd-41a9-b765-d4ca1019b08e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:55.190951 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8f44b9ef-98cd-41a9-b765-d4ca1019b08e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:55.205779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8f44b9ef-98cd-41a9-b765-d4ca1019b08e tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1544 microversion: 2.1 time: 0.174001 Jul 14 11:15:55.206395 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 390/776] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:55 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1544 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:55.228240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e34e01f6-28f2-4e3b-bc7e-3ebfff518f5f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:55.229057 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e34e01f6-28f2-4e3b-bc7e-3ebfff518f5f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:55.236470 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e34e01f6-28f2-4e3b-bc7e-3ebfff518f5f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:55.237240 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e34e01f6-28f2-4e3b-bc7e-3ebfff518f5f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:55.238456 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e34e01f6-28f2-4e3b-bc7e-3ebfff518f5f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:55.239192 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e34e01f6-28f2-4e3b-bc7e-3ebfff518f5f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:55.326095 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e34e01f6-28f2-4e3b-bc7e-3ebfff518f5f tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104929 Jul 14 11:15:55.326995 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 387/777] 10.222.0.75 () {58 vars in 1274 bytes} [Thu Jul 14 11:15:55 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:55.974525 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-19200e27-eaf7-4bf5-b78a-4075d002104a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:55.975289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-19200e27-eaf7-4bf5-b78a-4075d002104a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:55.982006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19200e27-eaf7-4bf5-b78a-4075d002104a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:55.982558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19200e27-eaf7-4bf5-b78a-4075d002104a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:55.983424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19200e27-eaf7-4bf5-b78a-4075d002104a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:55.984196 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19200e27-eaf7-4bf5-b78a-4075d002104a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:56.107128 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-19200e27-eaf7-4bf5-b78a-4075d002104a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:56.114604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-19200e27-eaf7-4bf5-b78a-4075d002104a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1312 microversion: 2.1 time: 0.144466 Jul 14 11:15:56.115201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 391/778] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:55 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:57.037539 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4e66c7b3-6e02-49b7-b64e-440db6391527 req-5455cefe-a452-412e-ab80-52ea9f4b3fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e926c16d-12f3-4547-a52f-5056741e44a3", "tag": "98da6298-514b-49c8-9c95-10d67d8b606e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:57.045996 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4e66c7b3-6e02-49b7-b64e-440db6391527 req-5455cefe-a452-412e-ab80-52ea9f4b3fff service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:57.046520 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4e66c7b3-6e02-49b7-b64e-440db6391527 req-5455cefe-a452-412e-ab80-52ea9f4b3fff service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:57.058035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4e66c7b3-6e02-49b7-b64e-440db6391527 req-5455cefe-a452-412e-ab80-52ea9f4b3fff service nova] Creating event network-changed:98da6298-514b-49c8-9c95-10d67d8b606e for instance e926c16d-12f3-4547-a52f-5056741e44a3 on hv-cinder-84893 Jul 14 11:15:57.064749 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4e66c7b3-6e02-49b7-b64e-440db6391527 req-5455cefe-a452-412e-ab80-52ea9f4b3fff service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031437 Jul 14 11:15:57.065458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 388/779] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:57.131344 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2959b270-2b2f-48a5-bacd-e3031e672475 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:57.131989 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2959b270-2b2f-48a5-bacd-e3031e672475 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:57.141526 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2959b270-2b2f-48a5-bacd-e3031e672475 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:57.141983 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2959b270-2b2f-48a5-bacd-e3031e672475 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:57.142766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2959b270-2b2f-48a5-bacd-e3031e672475 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:57.143209 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2959b270-2b2f-48a5-bacd-e3031e672475 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:57.447076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2959b270-2b2f-48a5-bacd-e3031e672475 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:57.454962 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2959b270-2b2f-48a5-bacd-e3031e672475 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1367 microversion: 2.1 time: 0.327927 Jul 14 11:15:57.455823 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 392/780] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:57 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:58.253457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6d37996-78bb-434a-bb63-957708223031 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:58.255556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6d37996-78bb-434a-bb63-957708223031 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:58.264434 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6d37996-78bb-434a-bb63-957708223031 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:58.265225 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6d37996-78bb-434a-bb63-957708223031 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:58.266450 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6d37996-78bb-434a-bb63-957708223031 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:58.266946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6d37996-78bb-434a-bb63-957708223031 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:58.295701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6d37996-78bb-434a-bb63-957708223031 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/ips" status: 200 len: 152 microversion: 2.20 time: 0.050571 Jul 14 11:15:58.296227 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 389/781] 10.222.0.75 () {60 vars in 1288 bytes} [Thu Jul 14 11:15:58 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:15:58.472185 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-43c46f02-2b33-4e8b-b51c-94fd31b18024 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:58.472821 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-43c46f02-2b33-4e8b-b51c-94fd31b18024 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:58.479702 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43c46f02-2b33-4e8b-b51c-94fd31b18024 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:58.480159 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43c46f02-2b33-4e8b-b51c-94fd31b18024 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:58.481032 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43c46f02-2b33-4e8b-b51c-94fd31b18024 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:58.481477 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43c46f02-2b33-4e8b-b51c-94fd31b18024 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:58.759345 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-43c46f02-2b33-4e8b-b51c-94fd31b18024 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:15:58.767103 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-43c46f02-2b33-4e8b-b51c-94fd31b18024 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1367 microversion: 2.1 time: 0.298717 Jul 14 11:15:58.767733 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 393/782] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:58 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:15:59.078795 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-6caedee4-0fbd-4a5f-b375-553f53e91fa3 req-3a417077-1442-45b1-9881-886f347bf99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae92658-6b4c-4f08-886d-9a0da70df211", "tag": "fc6de59e-9654-4e10-9a58-7bd91197de9a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:15:59.087274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6caedee4-0fbd-4a5f-b375-553f53e91fa3 req-3a417077-1442-45b1-9881-886f347bf99e service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:59.087759 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6caedee4-0fbd-4a5f-b375-553f53e91fa3 req-3a417077-1442-45b1-9881-886f347bf99e service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:59.098995 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-6caedee4-0fbd-4a5f-b375-553f53e91fa3 req-3a417077-1442-45b1-9881-886f347bf99e service nova] Creating event network-changed:fc6de59e-9654-4e10-9a58-7bd91197de9a for instance eae92658-6b4c-4f08-886d-9a0da70df211 on hv-cinder-84893 Jul 14 11:15:59.103785 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-6caedee4-0fbd-4a5f-b375-553f53e91fa3 req-3a417077-1442-45b1-9881-886f347bf99e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028604 Jul 14 11:15:59.104305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 390/783] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:59.783858 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cc8cc0ad-1ea2-4af5-a407-9f8645a811a6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:59.784466 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cc8cc0ad-1ea2-4af5-a407-9f8645a811a6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:15:59.790990 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc8cc0ad-1ea2-4af5-a407-9f8645a811a6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:59.791478 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc8cc0ad-1ea2-4af5-a407-9f8645a811a6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:59.792270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc8cc0ad-1ea2-4af5-a407-9f8645a811a6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:59.792705 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc8cc0ad-1ea2-4af5-a407-9f8645a811a6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:00.154404 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b5b39568-bae7-41a8-9530-7723cb38fbe3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:00.155046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b5b39568-bae7-41a8-9530-7723cb38fbe3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:00.161239 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5b39568-bae7-41a8-9530-7723cb38fbe3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:00.161692 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5b39568-bae7-41a8-9530-7723cb38fbe3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:00.162464 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5b39568-bae7-41a8-9530-7723cb38fbe3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:00.162902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5b39568-bae7-41a8-9530-7723cb38fbe3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:00.186912 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-b5b39568-bae7-41a8-9530-7723cb38fbe3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lazy-loading 'flavor' on Instance uuid 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:16:00.192427 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cc8cc0ad-1ea2-4af5-a407-9f8645a811a6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:00.206108 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cc8cc0ad-1ea2-4af5-a407-9f8645a811a6 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1367 microversion: 2.1 time: 0.425849 Jul 14 11:16:00.206706 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 394/784] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:15:59 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:16:00.452058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b5b39568-bae7-41a8-9530-7723cb38fbe3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/action" status: 202 len: 0 microversion: 2.20 time: 0.302220 Jul 14 11:16:00.452676 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 391/785] 10.222.0.75 () {62 vars in 1318 bytes} [Thu Jul 14 11:16:00 2022] POST /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:16:00.460641 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:00.461244 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:00.467292 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:00.467769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:00.468574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:00.469004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:00.598391 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:00.606338 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:00.607958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:00.609111 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2006f131-2c8f-4e97-ae6f-bac521d6a357 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.152315 Jul 14 11:16:00.609654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 395/786] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:00 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:01.223181 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-42e55f2b-3e48-4852-a14b-c61f59f9e082 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:01.223903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-42e55f2b-3e48-4852-a14b-c61f59f9e082 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:01.230438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42e55f2b-3e48-4852-a14b-c61f59f9e082 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:01.230884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42e55f2b-3e48-4852-a14b-c61f59f9e082 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:01.231693 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42e55f2b-3e48-4852-a14b-c61f59f9e082 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:01.232136 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42e55f2b-3e48-4852-a14b-c61f59f9e082 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:01.361511 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-42e55f2b-3e48-4852-a14b-c61f59f9e082 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:01.369381 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-42e55f2b-3e48-4852-a14b-c61f59f9e082 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1367 microversion: 2.1 time: 0.150957 Jul 14 11:16:01.369946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 392/787] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:16:01 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:16:01.629603 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:01.630046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:01.636168 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:01.636614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:01.637376 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:01.637806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:01.845396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:01.853778 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:01.855270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:01.859320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-72123fe1-54fd-46c1-8557-428cffe01238 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.231780 Jul 14 11:16:01.859320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 396/788] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:01 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:02.386214 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4445b24e-80e7-4769-ba25-e9ebd72a903d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:02.386837 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4445b24e-80e7-4769-ba25-e9ebd72a903d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:02.393358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4445b24e-80e7-4769-ba25-e9ebd72a903d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:02.393798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4445b24e-80e7-4769-ba25-e9ebd72a903d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:02.394573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4445b24e-80e7-4769-ba25-e9ebd72a903d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:02.395005 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4445b24e-80e7-4769-ba25-e9ebd72a903d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:02.529398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4445b24e-80e7-4769-ba25-e9ebd72a903d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:02.537914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4445b24e-80e7-4769-ba25-e9ebd72a903d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1367 microversion: 2.1 time: 0.155527 Jul 14 11:16:02.538491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 393/789] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:16:02 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:16:02.875566 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:02.876101 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:02.882626 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:02.883081 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:02.883869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:02.884307 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:03.012977 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:03.021521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:03.023013 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:03.024193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d2eba438-8e69-4960-9b1d-18383fe6a0b2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.152632 Jul 14 11:16:03.024746 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 397/790] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:02 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:03.557635 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9921a41c-701b-4406-b71c-1dc4015b4929 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:03.560731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9921a41c-701b-4406-b71c-1dc4015b4929 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:03.567268 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:03.575965 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9921a41c-701b-4406-b71c-1dc4015b4929 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:03.576434 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9921a41c-701b-4406-b71c-1dc4015b4929 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:03.577201 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9921a41c-701b-4406-b71c-1dc4015b4929 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:03.577630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9921a41c-701b-4406-b71c-1dc4015b4929 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:03.707600 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9921a41c-701b-4406-b71c-1dc4015b4929 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:03.714892 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9921a41c-701b-4406-b71c-1dc4015b4929 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1367 microversion: 2.1 time: 0.164651 Jul 14 11:16:03.715482 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 394/791] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:16:03 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:16:04.042240 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:04.042834 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:04.049314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:04.049760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:04.050508 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:04.051620 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:04.182085 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:04.190255 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:04.192313 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:04.193484 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4dbac54a-d183-422e-8531-21c8f317861f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.155190 Jul 14 11:16:04.194048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 398/792] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:04 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:04.565805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-27215662-5e5c-44a2-868c-15a27b85abee req-9a4d476f-b3bf-465f-b9d1-1d17bfce7786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae92658-6b4c-4f08-886d-9a0da70df211", "name": "network-vif-plugged", "status": "completed", "tag": "fc6de59e-9654-4e10-9a58-7bd91197de9a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:04.575190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-27215662-5e5c-44a2-868c-15a27b85abee req-9a4d476f-b3bf-465f-b9d1-1d17bfce7786 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:04.575670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-27215662-5e5c-44a2-868c-15a27b85abee req-9a4d476f-b3bf-465f-b9d1-1d17bfce7786 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:04.586760 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-27215662-5e5c-44a2-868c-15a27b85abee req-9a4d476f-b3bf-465f-b9d1-1d17bfce7786 service nova] Creating event network-vif-plugged:fc6de59e-9654-4e10-9a58-7bd91197de9a for instance eae92658-6b4c-4f08-886d-9a0da70df211 on hv-cinder-84893 Jul 14 11:16:04.591695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-27215662-5e5c-44a2-868c-15a27b85abee req-9a4d476f-b3bf-465f-b9d1-1d17bfce7786 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029709 Jul 14 11:16:04.592316 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 395/793] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:16:04.731270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-37261653-6fea-40d5-b0b6-59893b66fd01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:04.732104 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-37261653-6fea-40d5-b0b6-59893b66fd01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:04.738616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37261653-6fea-40d5-b0b6-59893b66fd01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:04.739054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37261653-6fea-40d5-b0b6-59893b66fd01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:04.739846 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37261653-6fea-40d5-b0b6-59893b66fd01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:04.740275 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37261653-6fea-40d5-b0b6-59893b66fd01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:04.799488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:04.822059 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=10 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:04.936532 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-37261653-6fea-40d5-b0b6-59893b66fd01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:04.944036 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-37261653-6fea-40d5-b0b6-59893b66fd01 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1367 microversion: 2.1 time: 0.216892 Jul 14 11:16:04.944601 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 399/794] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:16:04 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:16:05.208982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:05.213209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:05.213899 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:05.220647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:05.221091 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:05.221848 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:05.222276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:05.368252 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:05.379443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:05.381121 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:05.382296 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fcedf3ac-063c-4420-8840-36aed68c5aa5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.174295 Jul 14 11:16:05.382862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 396/795] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:05 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:05.960948 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-958ad7c0-b808-4ed3-a281-f56cf6052c78 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:05.961606 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-958ad7c0-b808-4ed3-a281-f56cf6052c78 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:05.968316 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-958ad7c0-b808-4ed3-a281-f56cf6052c78 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:05.968770 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-958ad7c0-b808-4ed3-a281-f56cf6052c78 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:05.969533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-958ad7c0-b808-4ed3-a281-f56cf6052c78 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:05.970220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-958ad7c0-b808-4ed3-a281-f56cf6052c78 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:06.115124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-958ad7c0-b808-4ed3-a281-f56cf6052c78 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:06.122640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-958ad7c0-b808-4ed3-a281-f56cf6052c78 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1367 microversion: 2.1 time: 0.165612 Jul 14 11:16:06.123434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 400/796] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:16:05 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:16:06.406426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:06.407046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:06.414048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:06.414496 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:06.415260 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:06.415732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:06.554813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:06.562742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:06.564274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:06.565432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a365b3d5-3905-4f99-8610-83d968cc1cf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.163241 Jul 14 11:16:06.565996 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 397/797] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:06 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:07.142555 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4a76ea7b-9b8f-4990-b3ed-aab240516fe7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:07.143153 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4a76ea7b-9b8f-4990-b3ed-aab240516fe7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:07.149767 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a76ea7b-9b8f-4990-b3ed-aab240516fe7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:07.150213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a76ea7b-9b8f-4990-b3ed-aab240516fe7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:07.150975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a76ea7b-9b8f-4990-b3ed-aab240516fe7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:07.151432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a76ea7b-9b8f-4990-b3ed-aab240516fe7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:07.280342 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4a76ea7b-9b8f-4990-b3ed-aab240516fe7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:07.288252 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4a76ea7b-9b8f-4990-b3ed-aab240516fe7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1558 microversion: 2.1 time: 0.149661 Jul 14 11:16:07.288815 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 401/798] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:16:07 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:16:07.304718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-394f79c1-9a79-4614-9e01-d28ecbfaead9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:07.305144 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-394f79c1-9a79-4614-9e01-d28ecbfaead9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:07.311032 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-394f79c1-9a79-4614-9e01-d28ecbfaead9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:07.311511 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-394f79c1-9a79-4614-9e01-d28ecbfaead9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:07.312266 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-394f79c1-9a79-4614-9e01-d28ecbfaead9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:07.312698 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-394f79c1-9a79-4614-9e01-d28ecbfaead9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:07.389673 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-394f79c1-9a79-4614-9e01-d28ecbfaead9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089113 Jul 14 11:16:07.390309 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 398/799] 10.222.0.75 () {58 vars in 1274 bytes} [Thu Jul 14 11:16:07 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:16:07.588135 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:07.588135 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:07.599804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:07.600248 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:07.601020 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:07.601449 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:07.742422 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:07.751136 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:07.752725 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:07.754412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dce1f74d-0cda-4e21-9238-51ddfd0ad90d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.171717 Jul 14 11:16:07.754987 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 402/800] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:07 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:08.545287 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-af3dab12-03dd-45f0-a115-f1e311eb92f6 req-21e79f58-a60f-4f69-8692-f0381ebf0993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae92658-6b4c-4f08-886d-9a0da70df211", "tag": "fc6de59e-9654-4e10-9a58-7bd91197de9a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:08.554014 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-af3dab12-03dd-45f0-a115-f1e311eb92f6 req-21e79f58-a60f-4f69-8692-f0381ebf0993 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:08.554438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-af3dab12-03dd-45f0-a115-f1e311eb92f6 req-21e79f58-a60f-4f69-8692-f0381ebf0993 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:08.573431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-af3dab12-03dd-45f0-a115-f1e311eb92f6 req-21e79f58-a60f-4f69-8692-f0381ebf0993 service nova] Creating event network-changed:fc6de59e-9654-4e10-9a58-7bd91197de9a for instance eae92658-6b4c-4f08-886d-9a0da70df211 on hv-cinder-84893 Jul 14 11:16:08.578676 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-af3dab12-03dd-45f0-a115-f1e311eb92f6 req-21e79f58-a60f-4f69-8692-f0381ebf0993 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037438 Jul 14 11:16:08.579279 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 399/801] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:16:08.772521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:08.773127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:08.779965 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:08.780418 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:08.781421 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:08.781867 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:08.974409 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:08.982701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:08.984327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:08.985586 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f3524e68-3a82-43f4-8703-6bc3adc857c7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.216921 Jul 14 11:16:08.996514 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 403/802] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:08 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:10.004991 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:10.005733 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:10.011986 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:10.012431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:10.013190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:10.013624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:10.144572 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:10.152454 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:10.153962 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:10.155094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-63ad75d5-c13c-4752-87fd-484eea1cf852 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.154891 Jul 14 11:16:10.155745 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 400/803] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:09 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:16:11.173491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:11.174096 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:11.181377 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:11.181839 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:11.182598 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:11.183038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:11.311938 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:11.320336 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:11.321830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:11.322981 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d80e3ad4-edc3-4bdb-b969-949490a6320b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.153537 Jul 14 11:16:11.323577 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 404/804] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:11 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:12.341070 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:12.341672 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:12.348204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:12.348655 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:12.349416 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:12.349852 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:12.483034 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:12.492845 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:12.494513 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:12.495776 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d1d1115c-e527-4c64-b13a-3d30bd0889d3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.158551 Jul 14 11:16:12.496352 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 401/805] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:12 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:13.514646 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:13.515180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:13.522538 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:13.522992 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:13.523815 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:13.524256 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:13.672194 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:13.675709 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:13.681331 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:13.682912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:13.684102 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6250420f-b431-4081-a067-f6abebaf7e26 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.173666 Jul 14 11:16:13.684667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 405/806] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:13 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:14.709494 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:14.710097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:14.716768 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:14.717212 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:14.717982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:14.718411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:14.844890 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:14.852716 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:14.854202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:14.855342 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dfa6da84-ffd3-4492-a4ff-ede9509db290 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.157184 Jul 14 11:16:14.855927 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 402/807] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:14 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:16:15.873000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:15.873627 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:15.880092 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:15.880544 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:15.881307 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:15.881744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:16.014665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:16.023254 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:16.024772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:16.025920 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-33f4f4e6-7dec-4be5-8a91-579e83249fb3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.156892 Jul 14 11:16:16.026470 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 406/808] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:15 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:17.044199 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:17.044748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:17.051877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:17.052326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:17.053341 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:17.053777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:17.057828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:17.182824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:17.190552 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:17.192082 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:17.193237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a0743217-9e33-4d5e-a603-21a683a11381 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.153046 Jul 14 11:16:17.200090 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 403/809] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:17 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:18.211429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:18.212021 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:18.218457 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:18.218908 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:18.219712 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:18.220152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:18.356568 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:18.365066 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:18.366571 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:18.367760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-852e051e-e365-489c-bde2-c298dccddf53 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1744 microversion: 2.20 time: 0.160258 Jul 14 11:16:18.368329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 407/810] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:18 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:19.386351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:19.386978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:19.393466 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:19.393907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:19.394691 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:19.395125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:19.526332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:19.534213 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:19.535742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:19.536893 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-105c9d19-723e-4cd0-99cd-b4496d259177 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1744 microversion: 2.20 time: 0.154441 Jul 14 11:16:19.537449 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 404/811] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:19 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:20.555368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:20.556058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:20.562403 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:20.562847 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:20.563628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:20.564058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:20.698057 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:20.707105 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:20.709385 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:20.710573 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0a68f32c-3f5e-45a7-bf44-cba56dd8d9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1744 microversion: 2.20 time: 0.159315 Jul 14 11:16:20.711969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-62b0c9da-6d8d-4372-8729-9b021470ac04 req-031d5b42-8c04-46ce-9fee-7210d6b5d749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431", "name": "network-vif-plugged", "status": "completed", "tag": "6a60328d-ee1e-44d3-8008-6151b2c4427f"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:20.720560 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-62b0c9da-6d8d-4372-8729-9b021470ac04 req-031d5b42-8c04-46ce-9fee-7210d6b5d749 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:20.721035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-62b0c9da-6d8d-4372-8729-9b021470ac04 req-031d5b42-8c04-46ce-9fee-7210d6b5d749 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:20.722119 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 408/812] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:20 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:20.735024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-62b0c9da-6d8d-4372-8729-9b021470ac04 req-031d5b42-8c04-46ce-9fee-7210d6b5d749 service nova] Creating event network-vif-plugged:6a60328d-ee1e-44d3-8008-6151b2c4427f for instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 on hv-cinder-84893 Jul 14 11:16:20.740217 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-62b0c9da-6d8d-4372-8729-9b021470ac04 req-031d5b42-8c04-46ce-9fee-7210d6b5d749 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 Jul 14 11:16:20.741184 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 405/813] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:16:21.729717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:21.730294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:21.736758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:21.737208 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:21.737973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:21.739084 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:21.872689 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:21.880960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:21.882466 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:21.883650 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6ac4c323-c217-4cae-a440-2d20f8f6f683 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1744 microversion: 2.20 time: 0.157867 Jul 14 11:16:21.884205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 409/814] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:21 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:22.902643 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:22.903332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:22.909545 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:22.909986 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:22.911261 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:22.911725 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:23.042592 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:23.050565 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:23.052943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:23.053639 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4b52ba22-f348-4a82-898a-3cf1bdb2a98b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1744 microversion: 2.20 time: 0.155716 Jul 14 11:16:23.054200 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 406/815] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:22 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:24.072548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:24.073210 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:24.079967 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:24.080417 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:24.081524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:24.082033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:24.248383 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:24.260535 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:24.262747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:24.264074 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0ae4bb1c-09b2-4436-bb0b-20d6c3cf1cda tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.195691 Jul 14 11:16:24.264990 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 410/816] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:24 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:25.282498 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:25.283826 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:25.292788 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:25.293232 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:25.294071 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:25.294454 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:25.438846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:25.447972 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:25.449453 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:25.450612 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab9dbc3e-283a-438f-a3b3-0194f85b9df3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.172221 Jul 14 11:16:25.451168 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 407/817] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:25 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:26.468327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:26.469986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:26.473789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=43 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:26.479304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:26.480180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:26.481164 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:26.481906 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:26.628519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:26.637504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:26.639002 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:26.640189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fd44368d-6bb6-44b0-91a1-7862aca9d8db tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.176017 Jul 14 11:16:26.640747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 411/818] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:26 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:27.660825 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:27.662234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:27.668925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:27.669659 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:27.670777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:27.671453 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:27.839798 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:27.852349 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:27.854713 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:27.855950 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3e8478ee-ee05-4e34-afee-546aef75648d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.200394 Jul 14 11:16:27.856721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 408/819] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:27 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:28.874216 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:28.874950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:28.882469 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:28.882924 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:28.883751 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:28.884156 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:29.041400 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:29.049810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:29.051897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:29.053502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-367bee79-23ac-4de5-b1a4-e12e4753ed14 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.183235 Jul 14 11:16:29.054071 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 412/820] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:28 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:30.111974 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:30.114027 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:30.122754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:30.123849 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:30.124763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:30.126081 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:30.283230 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:30.292289 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:30.293781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:30.295053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-45625194-1499-483b-ac76-f9facfe86887 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.189846 Jul 14 11:16:30.299544 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 409/821] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:30 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:31.314107 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:31.314755 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:31.322264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:31.322724 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:31.323536 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:31.323979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:31.471875 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:31.480295 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:31.481816 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:31.482991 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-45185a46-9b0e-41e0-be0e-a85f0b64ad8b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.172862 Jul 14 11:16:31.483574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 413/822] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:31 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:32.503794 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:32.504609 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:32.514080 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:32.514702 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:32.515928 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:32.516551 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:32.670709 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:32.679708 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:32.681215 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:32.682455 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bd7e08d7-b2e3-4d23-9c86-373b9082c307 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.184550 Jul 14 11:16:32.684146 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 410/823] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:32 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:33.700678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:33.701277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:33.708197 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:33.708639 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:33.709399 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:33.709853 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:33.853588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:33.861695 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:33.863265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:33.864440 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9dd591fd-c64f-4456-9b20-c36dd48778de tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1739 microversion: 2.20 time: 0.167658 Jul 14 11:16:33.865008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 414/824] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:33 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:34.883349 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:34.883963 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:34.886385 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=34 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:34.891997 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:34.892445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:34.893218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:34.893647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:35.028427 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:35.038721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:35.040265 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:35.041607 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-db45aa5c-cba6-48f9-b9ee-1ad9be41acf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1721 microversion: 2.20 time: 0.162300 Jul 14 11:16:35.042177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 411/825] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:34 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:36.060063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:36.060668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:36.067331 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:36.067807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:36.068571 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:36.069008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:36.221935 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:36.230352 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:36.231882 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:36.233029 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b6c879e0-3637-4fe4-9cea-5b97e187c8a7 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1721 microversion: 2.20 time: 0.176850 Jul 14 11:16:36.233576 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 415/826] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:36 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:36.776321 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-2418d06a-9c73-4b4e-a74c-709caeef8bfe req-c5e63478-14bd-475a-802d-61c92398a4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431", "name": "network-vif-unplugged", "status": "completed", "tag": "6a60328d-ee1e-44d3-8008-6151b2c4427f"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:36.785721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2418d06a-9c73-4b4e-a74c-709caeef8bfe req-c5e63478-14bd-475a-802d-61c92398a4af service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:36.786166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2418d06a-9c73-4b4e-a74c-709caeef8bfe req-c5e63478-14bd-475a-802d-61c92398a4af service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:36.797783 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-2418d06a-9c73-4b4e-a74c-709caeef8bfe req-c5e63478-14bd-475a-802d-61c92398a4af service nova] Creating event network-vif-unplugged:6a60328d-ee1e-44d3-8008-6151b2c4427f for instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 on hv-cinder-84893 Jul 14 11:16:36.803078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-2418d06a-9c73-4b4e-a74c-709caeef8bfe req-c5e63478-14bd-475a-802d-61c92398a4af service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030107 Jul 14 11:16:36.804137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 412/827] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:16:37.252503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:37.253161 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:37.260748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:37.261248 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:37.262221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:37.263407 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:37.395853 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:37.403830 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:37.405334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:37.406535 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fefe3ce9-4c5f-404c-8eab-1edcf3c71e17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1724 microversion: 2.20 time: 0.158713 Jul 14 11:16:37.407070 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 416/828] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:37 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:37.427455 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c724d7da-9563-452a-8f19-cda65685e3aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e86fd77e-18f1-4885-a577-108accb2e54e"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:37.427455 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c724d7da-9563-452a-8f19-cda65685e3aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:37.432862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c724d7da-9563-452a-8f19-cda65685e3aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:37.433300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c724d7da-9563-452a-8f19-cda65685e3aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:37.434055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c724d7da-9563-452a-8f19-cda65685e3aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:37.434478 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c724d7da-9563-452a-8f19-cda65685e3aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:37.701013 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c724d7da-9563-452a-8f19-cda65685e3aa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280603 Jul 14 11:16:37.701637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 413/829] 10.222.0.75 () {62 vars in 1363 bytes} [Thu Jul 14 11:16:37 2022] POST /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:16:37.814587 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6e677ff0-725b-4cf7-a581-ac7fdfa347f2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:37.815080 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6e677ff0-725b-4cf7-a581-ac7fdfa347f2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:37.821179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e677ff0-725b-4cf7-a581-ac7fdfa347f2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:37.821631 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e677ff0-725b-4cf7-a581-ac7fdfa347f2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:37.822394 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e677ff0-725b-4cf7-a581-ac7fdfa347f2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:37.822832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e677ff0-725b-4cf7-a581-ac7fdfa347f2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:38.074093 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6e677ff0-725b-4cf7-a581-ac7fdfa347f2 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/os-volume_attachments/e86fd77e-18f1-4885-a577-108accb2e54e" status: 202 len: 0 microversion: 2.20 time: 0.263270 Jul 14 11:16:38.074768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 417/830] 10.222.0.75 () {60 vars in 1456 bytes} [Thu Jul 14 11:16:37 2022] DELETE /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/os-volume_attachments/e86fd77e-18f1-4885-a577-108accb2e54e => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:16:38.130488 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-78e7b759-d5a9-497c-9ba7-808bf97efc12 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:38.131044 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-78e7b759-d5a9-497c-9ba7-808bf97efc12 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:38.137529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78e7b759-d5a9-497c-9ba7-808bf97efc12 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:38.137972 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78e7b759-d5a9-497c-9ba7-808bf97efc12 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:38.138723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78e7b759-d5a9-497c-9ba7-808bf97efc12 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:38.139151 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78e7b759-d5a9-497c-9ba7-808bf97efc12 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:38.218336 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-78e7b759-d5a9-497c-9ba7-808bf97efc12 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "POST /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/action" status: 202 len: 0 microversion: 2.20 time: 0.091733 Jul 14 11:16:38.218944 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 414/831] 10.222.0.75 () {62 vars in 1318 bytes} [Thu Jul 14 11:16:38 2022] POST /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:16:38.228176 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:38.228869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:38.235693 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:38.236222 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:38.237000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:38.237434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:38.380126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:38.387993 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:38.389500 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:38.390651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-61914198-3f94-46c4-8ddd-2ba816b86612 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1672 microversion: 2.20 time: 0.166944 Jul 14 11:16:38.391203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 418/832] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:38 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:39.411377 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:39.412624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:39.418780 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:39.419252 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:39.420039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:39.420463 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:39.552388 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:39.560608 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:39.562106 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:39.563246 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-17528762-3a86-4478-9489-66afab83610d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.157656 Jul 14 11:16:39.563826 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 415/833] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:39 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:40.581549 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:40.582258 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:40.588588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:40.589041 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:40.589829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:40.590266 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:40.798412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:40.809014 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:40.810798 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:40.812176 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a2110d32-ddfd-4dfd-91b2-80eb9cb67080 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.234550 Jul 14 11:16:40.822968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 419/834] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:40 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:41.830320 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:41.830905 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:41.838732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:41.839159 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:41.839994 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:41.840426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:41.992328 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:42.001646 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:42.003468 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:42.006202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-36cf2045-6fcf-4a70-9877-4ae6df7dabf5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.179749 Jul 14 11:16:42.007428 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 416/835] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:41 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:43.025861 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:43.026667 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:43.034670 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:43.035416 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:43.036580 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:43.037183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:43.040894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:43.190327 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:43.202505 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:43.204288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:43.205465 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f4986ff5-7881-4c27-8cc0-65ed5a418135 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.184108 Jul 14 11:16:43.206345 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 420/836] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:43 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:44.225155 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:44.225757 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:44.234331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:44.235064 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:44.235893 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:44.236350 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:44.258392 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:44.382526 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:44.390218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:44.391709 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:44.392841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6f378ef-3f8c-4c93-946c-bce753c4229f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.172668 Jul 14 11:16:44.393394 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 417/837] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:44 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:45.411960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:45.412539 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:45.419514 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:45.419975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:45.420769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:45.421208 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:45.564185 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:45.572862 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:45.574333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:45.575551 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e2f18b2b-0f5f-441b-9af7-9e0d5bca4c7a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.168093 Jul 14 11:16:45.576110 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 421/838] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:45 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:46.594237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:46.594884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:46.601693 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:46.602136 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:46.602911 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:46.603345 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:46.748512 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:46.757560 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:46.759226 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:46.760494 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-af43af80-3908-49fb-b422-3cc218b92bc8 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.170295 Jul 14 11:16:46.761438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 418/839] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:46 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:47.782187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:47.783215 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:47.789829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:47.790264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:47.791115 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:47.791502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:47.959714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:47.967875 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:47.969393 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:47.970781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-89dcb809-f7ba-4d77-9b28-7220e7958689 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.194942 Jul 14 11:16:47.971425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 422/840] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:47 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:48.990235 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:48.990912 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:48.998326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:48.998779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:48.999606 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:49.000047 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:49.142527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:49.151793 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:49.153333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:49.154511 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bd4842d0-3fce-4059-b74d-67f4615bbf88 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.168743 Jul 14 11:16:49.155090 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 419/841] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:48 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:50.173157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:50.173754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:50.181308 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:50.181760 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:50.182539 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:50.182982 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:50.315198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:50.323139 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:50.324684 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:50.325872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c4e53a8f-11c2-46dd-9e86-3032ddbed4fd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.156639 Jul 14 11:16:50.326438 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 423/842] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:50 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:51.345044 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:51.345670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:51.352794 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:51.353246 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:51.354039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:51.354476 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:51.485349 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:51.496641 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:51.498125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:51.499265 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c3c8a9ad-2a9a-4d94-a4c6-b0f133d3eeaa tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.158526 Jul 14 11:16:51.499870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 420/843] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:51 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:52.518087 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:52.518640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:52.525100 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:52.525542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:52.526299 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:52.526733 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:52.657652 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:52.666189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:52.667738 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:52.668915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-98ded2ce-b294-490c-8a9a-57e00ca2a124 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.154958 Jul 14 11:16:52.669460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 424/844] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:52 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:53.687800 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:53.688401 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:53.695317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:53.695803 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:53.696570 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:53.697007 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:53.828678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:53.837195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:53.838687 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:53.839862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-92e2a540-006f-489e-ac89-ca8b8ec21b5d tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.155946 Jul 14 11:16:53.840428 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 421/845] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:53 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:54.858599 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:54.859215 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:54.866866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:54.867315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:54.868152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:54.868588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:55.034502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:55.044634 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:55.046161 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:55.047460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-14a0e3a2-a653-4ccd-a075-336e2217cadf tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.192744 Jul 14 11:16:55.048038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 425/846] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:54 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:56.066677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:56.067354 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:56.073786 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:56.074223 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:56.074978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:56.075434 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:56.234868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:56.243653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:56.245294 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:56.246566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-05035272-3782-47a1-979f-fd7c1655148a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.183811 Jul 14 11:16:56.247160 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 422/847] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:56 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:56.912932 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-678c3287-f0f6-47c1-9351-780124a44a6e req-f64a4a23-58ec-464b-883f-121d89284b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431", "name": "network-vif-plugged", "status": "completed", "tag": "6a60328d-ee1e-44d3-8008-6151b2c4427f"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:56.917129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=30 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:56.923990 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-678c3287-f0f6-47c1-9351-780124a44a6e req-f64a4a23-58ec-464b-883f-121d89284b58 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:56.924436 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-678c3287-f0f6-47c1-9351-780124a44a6e req-f64a4a23-58ec-464b-883f-121d89284b58 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:57.089623 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-678c3287-f0f6-47c1-9351-780124a44a6e req-f64a4a23-58ec-464b-883f-121d89284b58 service nova] Creating event network-vif-plugged:6a60328d-ee1e-44d3-8008-6151b2c4427f for instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 on hv-cinder-84893 Jul 14 11:16:57.094894 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-678c3287-f0f6-47c1-9351-780124a44a6e req-f64a4a23-58ec-464b-883f-121d89284b58 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186215 Jul 14 11:16:57.095583 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 426/848] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:16:57.266632 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:57.267191 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:57.274640 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:57.275092 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:57.275903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:57.276336 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:57.422834 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:57.433031 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:57.434918 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:57.436456 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b43668f5-287c-4600-9ea5-d1c6c145ab17 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.174762 Jul 14 11:16:57.437110 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 423/849] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:57 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:58.456724 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:58.457494 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:58.463665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:58.464106 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:58.464854 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:58.465284 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:58.609487 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:58.617694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:58.619206 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:58.620404 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ad2f61cb-7b84-4fbc-8ed3-42c0ef8da393 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.168581 Jul 14 11:16:58.620963 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 427/850] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:58 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:59.639259 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:59.640087 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:16:59.647948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:59.648752 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:59.649703 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:59.650261 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:59.793882 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:59.802990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:59.804559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:16:59.805730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9dbc0017-08c3-4c4c-a0f6-cf51dc5a844e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1730 microversion: 2.20 time: 0.170474 Jul 14 11:16:59.806293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 424/851] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:16:59 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:00.825042 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:00.825668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:00.832985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:00.833437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:00.834198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:00.834627 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:00.964213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:00.972224 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:00.974405 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:00.975598 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d589c1be-3c8e-4dfa-b17d-493c140f6b97 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1717 microversion: 2.20 time: 0.154417 Jul 14 11:17:00.976159 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 428/852] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:00 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:26.655063 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc3d5af8-124b-420f-805a-6e0d1cd67f6d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:26.655717 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc3d5af8-124b-420f-805a-6e0d1cd67f6d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:26.657744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=29 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:26.658396 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=44 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:26.664970 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3d5af8-124b-420f-805a-6e0d1cd67f6d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:26.665424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3d5af8-124b-420f-805a-6e0d1cd67f6d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:26.666198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3d5af8-124b-420f-805a-6e0d1cd67f6d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:26.666637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3d5af8-124b-420f-805a-6e0d1cd67f6d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:26.691749 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc3d5af8-124b-420f-805a-6e0d1cd67f6d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/ips" status: 200 len: 142 microversion: 2.1 time: 0.040496 Jul 14 11:17:26.692334 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 425/853] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:17:26 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/ips => generated 142 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:28.023621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3032b095-46be-414f-963d-8f2e8876e903 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0feffb1f-ac61-473a-a146-a435a00d2e56"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:28.024699 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3032b095-46be-414f-963d-8f2e8876e903 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:28.027015 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=5 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:28.027753 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=49 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:28.033908 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3032b095-46be-414f-963d-8f2e8876e903 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.034365 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3032b095-46be-414f-963d-8f2e8876e903 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.035424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3032b095-46be-414f-963d-8f2e8876e903 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.035679 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3032b095-46be-414f-963d-8f2e8876e903 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.398772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3032b095-46be-414f-963d-8f2e8876e903 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379973 Jul 14 11:17:28.399372 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 429/854] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:17:28 2022] POST /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:35.934602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2ea7bc5b-ebfc-4336-9c8d-4cb7429edfa2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:35.935935 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2ea7bc5b-ebfc-4336-9c8d-4cb7429edfa2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:35.944105 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ea7bc5b-ebfc-4336-9c8d-4cb7429edfa2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.944558 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ea7bc5b-ebfc-4336-9c8d-4cb7429edfa2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.945340 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ea7bc5b-ebfc-4336-9c8d-4cb7429edfa2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.945774 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ea7bc5b-ebfc-4336-9c8d-4cb7429edfa2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.977222 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2ea7bc5b-ebfc-4336-9c8d-4cb7429edfa2 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052583 Jul 14 11:17:35.977805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 426/855] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:17:35 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:35.989585 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7f52b9fb-ccf7-4b77-a14c-f13e8c2e3818 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:35.990524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7f52b9fb-ccf7-4b77-a14c-f13e8c2e3818 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:35.997537 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f52b9fb-ccf7-4b77-a14c-f13e8c2e3818 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.998072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f52b9fb-ccf7-4b77-a14c-f13e8c2e3818 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.998903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f52b9fb-ccf7-4b77-a14c-f13e8c2e3818 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.999346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f52b9fb-ccf7-4b77-a14c-f13e8c2e3818 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:36.030013 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7f52b9fb-ccf7-4b77-a14c-f13e8c2e3818 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/0feffb1f-ac61-473a-a146-a435a00d2e56" status: 200 len: 194 microversion: 2.1 time: 0.045791 Jul 14 11:17:36.030700 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 430/856] 10.222.0.75 () {58 vars in 1412 bytes} [Thu Jul 14 11:17:35 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/0feffb1f-ac61-473a-a146-a435a00d2e56 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:37.458902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3e93c018-df16-45b5-a415-50622486d126 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5959668e-6e67-4292-ae8d-ca4ad5636ce9"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:37.460121 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3e93c018-df16-45b5-a415-50622486d126 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:37.467563 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e93c018-df16-45b5-a415-50622486d126 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:37.468017 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e93c018-df16-45b5-a415-50622486d126 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:37.468848 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e93c018-df16-45b5-a415-50622486d126 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:37.469280 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e93c018-df16-45b5-a415-50622486d126 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:37.872907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3e93c018-df16-45b5-a415-50622486d126 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "POST /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418305 Jul 14 11:17:37.873744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 427/857] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:17:37 2022] POST /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:38.087044 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bc274583-3cb3-4fcc-aae0-8de4ecfb5097 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:38.087729 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bc274583-3cb3-4fcc-aae0-8de4ecfb5097 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:38.094504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc274583-3cb3-4fcc-aae0-8de4ecfb5097 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:38.095153 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc274583-3cb3-4fcc-aae0-8de4ecfb5097 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:38.095978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc274583-3cb3-4fcc-aae0-8de4ecfb5097 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:38.097004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc274583-3cb3-4fcc-aae0-8de4ecfb5097 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:38.121325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bc274583-3cb3-4fcc-aae0-8de4ecfb5097 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/ips" status: 200 len: 150 microversion: 2.1 time: 0.038803 Jul 14 11:17:38.121898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 431/858] 10.222.0.75 () {58 vars in 1247 bytes} [Thu Jul 14 11:17:38 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:39.510161 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b13121de-d8af-4562-be8f-77dae70bd64b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02caa576-b3f0-474a-9cfb-aaf92cc9996e"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:39.512277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b13121de-d8af-4562-be8f-77dae70bd64b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:39.521144 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b13121de-d8af-4562-be8f-77dae70bd64b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:39.521597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b13121de-d8af-4562-be8f-77dae70bd64b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:39.522918 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b13121de-d8af-4562-be8f-77dae70bd64b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:39.523358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b13121de-d8af-4562-be8f-77dae70bd64b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:39.824933 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b13121de-d8af-4562-be8f-77dae70bd64b tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "POST /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321849 Jul 14 11:17:39.825730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 428/859] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:17:39 2022] POST /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:45.467884 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a05edeba-d579-4b0e-afe0-ac30f4c61c3c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:45.468878 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a05edeba-d579-4b0e-afe0-ac30f4c61c3c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:45.477346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a05edeba-d579-4b0e-afe0-ac30f4c61c3c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.477796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a05edeba-d579-4b0e-afe0-ac30f4c61c3c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.478603 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a05edeba-d579-4b0e-afe0-ac30f4c61c3c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.479205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a05edeba-d579-4b0e-afe0-ac30f4c61c3c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.521543 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a05edeba-d579-4b0e-afe0-ac30f4c61c3c tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058013 Jul 14 11:17:45.522198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 432/860] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:17:45 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:45.664906 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-914eb1cb-2cda-461e-8b86-9b2e7dd05961 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:45.665806 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-914eb1cb-2cda-461e-8b86-9b2e7dd05961 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:45.672800 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-914eb1cb-2cda-461e-8b86-9b2e7dd05961 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.673256 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-914eb1cb-2cda-461e-8b86-9b2e7dd05961 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.674090 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-914eb1cb-2cda-461e-8b86-9b2e7dd05961 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.674522 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-914eb1cb-2cda-461e-8b86-9b2e7dd05961 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.708973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-914eb1cb-2cda-461e-8b86-9b2e7dd05961 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/0feffb1f-ac61-473a-a146-a435a00d2e56" status: 200 len: 194 microversion: 2.1 time: 0.048552 Jul 14 11:17:45.715066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 429/861] 10.222.0.75 () {58 vars in 1412 bytes} [Thu Jul 14 11:17:45 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/0feffb1f-ac61-473a-a146-a435a00d2e56 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:45.728702 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5b019483-d80c-45a2-99a6-f4b1daa39031 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:45.730415 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5b019483-d80c-45a2-99a6-f4b1daa39031 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:45.743882 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b019483-d80c-45a2-99a6-f4b1daa39031 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.745164 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b019483-d80c-45a2-99a6-f4b1daa39031 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.747306 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b019483-d80c-45a2-99a6-f4b1daa39031 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.748442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b019483-d80c-45a2-99a6-f4b1daa39031 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.858621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-5b019483-d80c-45a2-99a6-f4b1daa39031 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lazy-loading 'services' on Instance uuid e926c16d-12f3-4547-a52f-5056741e44a3 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:17:45.939864 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5b019483-d80c-45a2-99a6-f4b1daa39031 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/0feffb1f-ac61-473a-a146-a435a00d2e56" status: 202 len: 0 microversion: 2.1 time: 0.221111 Jul 14 11:17:45.941218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 433/862] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:17:45 2022] DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/0feffb1f-ac61-473a-a146-a435a00d2e56 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:17:52.891992 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-083c6fff-954f-40bb-a0d8-52438c6fc7d0 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:52.892931 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-083c6fff-954f-40bb-a0d8-52438c6fc7d0 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:52.901799 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-083c6fff-954f-40bb-a0d8-52438c6fc7d0 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:52.902426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-083c6fff-954f-40bb-a0d8-52438c6fc7d0 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:52.903764 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-083c6fff-954f-40bb-a0d8-52438c6fc7d0 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:52.904493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-083c6fff-954f-40bb-a0d8-52438c6fc7d0 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.024253 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-083c6fff-954f-40bb-a0d8-52438c6fc7d0 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lazy-loading 'services' on Instance uuid eae92658-6b4c-4f08-886d-9a0da70df211 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:17:53.107005 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-083c6fff-954f-40bb-a0d8-52438c6fc7d0 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments/02caa576-b3f0-474a-9cfb-aaf92cc9996e" status: 202 len: 0 microversion: 2.1 time: 0.220527 Jul 14 11:17:53.107766 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 430/863] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:17:52 2022] DELETE /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments/02caa576-b3f0-474a-9cfb-aaf92cc9996e => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:17:53.118863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-13b43855-4125-4373-a8c8-5c9e430642b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:53.120466 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-13b43855-4125-4373-a8c8-5c9e430642b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:53.127174 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13b43855-4125-4373-a8c8-5c9e430642b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.128412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13b43855-4125-4373-a8c8-5c9e430642b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.129261 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13b43855-4125-4373-a8c8-5c9e430642b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.129707 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13b43855-4125-4373-a8c8-5c9e430642b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.165115 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-13b43855-4125-4373-a8c8-5c9e430642b9 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051278 Jul 14 11:17:53.165616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 434/864] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:17:53 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:53.474112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-335c9fb4-e3af-4b30-8ce3-009f3a6e0b45 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:53.475136 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-335c9fb4-e3af-4b30-8ce3-009f3a6e0b45 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:53.486600 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-335c9fb4-e3af-4b30-8ce3-009f3a6e0b45 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.487474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-335c9fb4-e3af-4b30-8ce3-009f3a6e0b45 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.488853 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-335c9fb4-e3af-4b30-8ce3-009f3a6e0b45 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.489641 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-335c9fb4-e3af-4b30-8ce3-009f3a6e0b45 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.537328 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-335c9fb4-e3af-4b30-8ce3-009f3a6e0b45 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/5959668e-6e67-4292-ae8d-ca4ad5636ce9" status: 200 len: 194 microversion: 2.1 time: 0.071803 Jul 14 11:17:53.538324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 431/865] 10.222.0.75 () {58 vars in 1412 bytes} [Thu Jul 14 11:17:53 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/5959668e-6e67-4292-ae8d-ca4ad5636ce9 => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:53.548909 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7d0cf8c2-29ab-481a-b073-4e44e959f467 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:53.549468 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7d0cf8c2-29ab-481a-b073-4e44e959f467 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:53.556442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d0cf8c2-29ab-481a-b073-4e44e959f467 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.557157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d0cf8c2-29ab-481a-b073-4e44e959f467 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.557696 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d0cf8c2-29ab-481a-b073-4e44e959f467 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.558137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d0cf8c2-29ab-481a-b073-4e44e959f467 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.667164 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-7d0cf8c2-29ab-481a-b073-4e44e959f467 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lazy-loading 'services' on Instance uuid e926c16d-12f3-4547-a52f-5056741e44a3 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:17:53.759709 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7d0cf8c2-29ab-481a-b073-4e44e959f467 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/5959668e-6e67-4292-ae8d-ca4ad5636ce9" status: 202 len: 0 microversion: 2.1 time: 0.214153 Jul 14 11:17:53.763857 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 435/866] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:17:53 2022] DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments/5959668e-6e67-4292-ae8d-ca4ad5636ce9 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:17:54.177887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ad066b09-8b91-4d49-bf31-86e46c7bb813 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:54.179081 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ad066b09-8b91-4d49-bf31-86e46c7bb813 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:54.185964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad066b09-8b91-4d49-bf31-86e46c7bb813 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.186436 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad066b09-8b91-4d49-bf31-86e46c7bb813 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.187217 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad066b09-8b91-4d49-bf31-86e46c7bb813 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.187752 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad066b09-8b91-4d49-bf31-86e46c7bb813 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.224953 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ad066b09-8b91-4d49-bf31-86e46c7bb813 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051705 Jul 14 11:17:54.225537 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 432/867] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:17:54 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:54.967454 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f1ccaeed-02d4-43cc-be9f-d734798fec24 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:54.968510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f1ccaeed-02d4-43cc-be9f-d734798fec24 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:54.976599 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1ccaeed-02d4-43cc-be9f-d734798fec24 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.977176 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1ccaeed-02d4-43cc-be9f-d734798fec24 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.977982 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1ccaeed-02d4-43cc-be9f-d734798fec24 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.978420 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1ccaeed-02d4-43cc-be9f-d734798fec24 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.012965 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f1ccaeed-02d4-43cc-be9f-d734798fec24 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051174 Jul 14 11:17:55.013548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 436/868] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:17:54 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:17:55.150119 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7f758f78-a751-4efa-b1ee-0982bcec2bbf tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:55.151306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7f758f78-a751-4efa-b1ee-0982bcec2bbf tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:55.158386 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f758f78-a751-4efa-b1ee-0982bcec2bbf tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.158998 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f758f78-a751-4efa-b1ee-0982bcec2bbf tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.159925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f758f78-a751-4efa-b1ee-0982bcec2bbf tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.160493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f758f78-a751-4efa-b1ee-0982bcec2bbf tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.196633 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7f758f78-a751-4efa-b1ee-0982bcec2bbf tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050615 Jul 14 11:17:55.200969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 433/869] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:17:55 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:17:55.237971 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1667d449-a462-4f8c-a1ab-78c69cd27191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:55.239158 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1667d449-a462-4f8c-a1ab-78c69cd27191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:55.247965 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1667d449-a462-4f8c-a1ab-78c69cd27191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.248602 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1667d449-a462-4f8c-a1ab-78c69cd27191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.249482 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1667d449-a462-4f8c-a1ab-78c69cd27191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.250040 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1667d449-a462-4f8c-a1ab-78c69cd27191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.278131 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-461ad997-26af-4d75-b51c-4902c62761c9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:55.278841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-461ad997-26af-4d75-b51c-4902c62761c9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:55.286684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-461ad997-26af-4d75-b51c-4902c62761c9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.287294 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-461ad997-26af-4d75-b51c-4902c62761c9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.288421 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-461ad997-26af-4d75-b51c-4902c62761c9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.289024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-461ad997-26af-4d75-b51c-4902c62761c9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.292708 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1667d449-a462-4f8c-a1ab-78c69cd27191 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059530 Jul 14 11:17:55.293971 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 437/870] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:17:55 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:17:55.333457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-461ad997-26af-4d75-b51c-4902c62761c9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:17:55.387842 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-962c6cce-539c-4b66-8660-e211d4977a31 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:55.388347 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-962c6cce-539c-4b66-8660-e211d4977a31 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:55.396391 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-962c6cce-539c-4b66-8660-e211d4977a31 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.396851 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-962c6cce-539c-4b66-8660-e211d4977a31 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.397742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-962c6cce-539c-4b66-8660-e211d4977a31 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.398271 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-962c6cce-539c-4b66-8660-e211d4977a31 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.427520 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-962c6cce-539c-4b66-8660-e211d4977a31 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:17:55.464312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-461ad997-26af-4d75-b51c-4902c62761c9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 204 len: 0 microversion: 2.1 time: 0.189636 Jul 14 11:17:55.465053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 434/871] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:17:55 2022] DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:17:55.480523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-802ba2b5-f286-4444-86ab-e64d062ae9c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:55.481841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-802ba2b5-f286-4444-86ab-e64d062ae9c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:55.495118 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-802ba2b5-f286-4444-86ab-e64d062ae9c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.497158 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-802ba2b5-f286-4444-86ab-e64d062ae9c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.497835 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-802ba2b5-f286-4444-86ab-e64d062ae9c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.498447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-802ba2b5-f286-4444-86ab-e64d062ae9c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.555579 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-962c6cce-539c-4b66-8660-e211d4977a31 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 204 len: 0 microversion: 2.1 time: 0.170795 Jul 14 11:17:55.556642 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 438/872] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:17:55 2022] DELETE /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:17:55.568141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-937d8aa0-56e3-4328-b2e7-3c5fd015c9fe tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:55.568848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-937d8aa0-56e3-4328-b2e7-3c5fd015c9fe tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:55.575256 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-937d8aa0-56e3-4328-b2e7-3c5fd015c9fe tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.575744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-937d8aa0-56e3-4328-b2e7-3c5fd015c9fe tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.576678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-937d8aa0-56e3-4328-b2e7-3c5fd015c9fe tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.577091 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-937d8aa0-56e3-4328-b2e7-3c5fd015c9fe tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.693986 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-802ba2b5-f286-4444-86ab-e64d062ae9c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:55.703069 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-802ba2b5-f286-4444-86ab-e64d062ae9c5 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1668 microversion: 2.1 time: 0.229908 Jul 14 11:17:55.703801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 435/873] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:55 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1668 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:55.791005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-937d8aa0-56e3-4328-b2e7-3c5fd015c9fe tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:55.799095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-937d8aa0-56e3-4328-b2e7-3c5fd015c9fe tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1682 microversion: 2.1 time: 0.235758 Jul 14 11:17:55.800343 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 439/874] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:55 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:56.723058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f191f89b-57e1-4983-a5f6-f84ad77b8722 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:56.723776 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f191f89b-57e1-4983-a5f6-f84ad77b8722 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:56.726353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:56.731979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f191f89b-57e1-4983-a5f6-f84ad77b8722 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:56.732440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f191f89b-57e1-4983-a5f6-f84ad77b8722 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:56.733214 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f191f89b-57e1-4983-a5f6-f84ad77b8722 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:56.733640 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f191f89b-57e1-4983-a5f6-f84ad77b8722 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:56.738201 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:56.822806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f3ed6cbe-6a59-4fb7-807e-60b25d8b3a29 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:56.825024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f3ed6cbe-6a59-4fb7-807e-60b25d8b3a29 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:56.838473 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3ed6cbe-6a59-4fb7-807e-60b25d8b3a29 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:56.839608 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3ed6cbe-6a59-4fb7-807e-60b25d8b3a29 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:56.841025 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3ed6cbe-6a59-4fb7-807e-60b25d8b3a29 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:56.841769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f3ed6cbe-6a59-4fb7-807e-60b25d8b3a29 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:56.902344 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f191f89b-57e1-4983-a5f6-f84ad77b8722 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:56.915112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f191f89b-57e1-4983-a5f6-f84ad77b8722 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1668 microversion: 2.1 time: 0.196238 Jul 14 11:17:56.916428 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 436/875] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:56 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1668 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:57.021846 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f3ed6cbe-6a59-4fb7-807e-60b25d8b3a29 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:57.030966 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f3ed6cbe-6a59-4fb7-807e-60b25d8b3a29 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1682 microversion: 2.1 time: 0.215905 Jul 14 11:17:57.031579 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 440/876] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:56 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:57.942306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7d07717c-2ecc-4cc9-aaaf-e727851935ad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:57.943302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7d07717c-2ecc-4cc9-aaaf-e727851935ad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:57.950686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d07717c-2ecc-4cc9-aaaf-e727851935ad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:57.951234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d07717c-2ecc-4cc9-aaaf-e727851935ad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:57.952162 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d07717c-2ecc-4cc9-aaaf-e727851935ad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:57.952802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d07717c-2ecc-4cc9-aaaf-e727851935ad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.050547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dff41e50-b5f4-49be-a5bb-d5983f4c4d8d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:58.051168 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dff41e50-b5f4-49be-a5bb-d5983f4c4d8d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:58.054147 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:58.061427 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dff41e50-b5f4-49be-a5bb-d5983f4c4d8d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:58.061885 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dff41e50-b5f4-49be-a5bb-d5983f4c4d8d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.062833 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dff41e50-b5f4-49be-a5bb-d5983f4c4d8d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:58.063270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dff41e50-b5f4-49be-a5bb-d5983f4c4d8d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.067572 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:58.117869 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7d07717c-2ecc-4cc9-aaaf-e727851935ad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:58.127880 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7d07717c-2ecc-4cc9-aaaf-e727851935ad tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1668 microversion: 2.1 time: 0.190964 Jul 14 11:17:58.128510 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 437/877] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:57 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1668 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:58.254710 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dff41e50-b5f4-49be-a5bb-d5983f4c4d8d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:58.263942 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dff41e50-b5f4-49be-a5bb-d5983f4c4d8d tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1682 microversion: 2.1 time: 0.218554 Jul 14 11:17:58.264668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 441/878] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:58 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:59.153426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c54c968f-f549-4732-8ca5-6e3500392dc4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:59.154432 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c54c968f-f549-4732-8ca5-6e3500392dc4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:59.163737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c54c968f-f549-4732-8ca5-6e3500392dc4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:59.164354 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c54c968f-f549-4732-8ca5-6e3500392dc4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:59.165236 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c54c968f-f549-4732-8ca5-6e3500392dc4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:59.165889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c54c968f-f549-4732-8ca5-6e3500392dc4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:59.285761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-50e91c95-5085-4823-98cc-ef329cd60e81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:59.286933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-50e91c95-5085-4823-98cc-ef329cd60e81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:59.300530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-50e91c95-5085-4823-98cc-ef329cd60e81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:59.301246 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-50e91c95-5085-4823-98cc-ef329cd60e81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:59.302737 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-50e91c95-5085-4823-98cc-ef329cd60e81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:59.304131 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-50e91c95-5085-4823-98cc-ef329cd60e81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:59.358932 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c54c968f-f549-4732-8ca5-6e3500392dc4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:59.369500 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c54c968f-f549-4732-8ca5-6e3500392dc4 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1668 microversion: 2.1 time: 0.220266 Jul 14 11:17:59.370312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 438/879] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:59 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:59.886769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-50e91c95-5085-4823-98cc-ef329cd60e81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:59.900885 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-50e91c95-5085-4823-98cc-ef329cd60e81 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1682 microversion: 2.1 time: 0.622286 Jul 14 11:17:59.901973 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 442/880] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:59 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1682 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:00.389994 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bd40487c-2172-4a66-b905-9e054a353ba6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:00.391007 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bd40487c-2172-4a66-b905-9e054a353ba6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:00.400235 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd40487c-2172-4a66-b905-9e054a353ba6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.401005 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd40487c-2172-4a66-b905-9e054a353ba6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:00.401966 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd40487c-2172-4a66-b905-9e054a353ba6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.402602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd40487c-2172-4a66-b905-9e054a353ba6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:00.505118 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd40487c-2172-4a66-b905-9e054a353ba6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7c1a5f674c4dfbb969ac37c5102408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7cf89df79d64153a73a5ec4d49f376f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:00.516039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bd40487c-2172-4a66-b905-9e054a353ba6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 200 len: 1601 microversion: 2.1 time: 0.130529 Jul 14 11:18:00.516697 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 439/881] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:00 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 1601 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:18:00.761440 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-c3675baf-6e51-49fb-aad5-a1ce10a50847 req-e1df12c3-a459-4f96-96df-7eb97ae02c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e926c16d-12f3-4547-a52f-5056741e44a3", "name": "network-vif-deleted", "tag": "98da6298-514b-49c8-9c95-10d67d8b606e"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:18:00.811697 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-c3675baf-6e51-49fb-aad5-a1ce10a50847 req-e1df12c3-a459-4f96-96df-7eb97ae02c7c service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.812510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-c3675baf-6e51-49fb-aad5-a1ce10a50847 req-e1df12c3-a459-4f96-96df-7eb97ae02c7c service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:00.840960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-c3675baf-6e51-49fb-aad5-a1ce10a50847 req-e1df12c3-a459-4f96-96df-7eb97ae02c7c service nova] Creating event network-vif-deleted:98da6298-514b-49c8-9c95-10d67d8b606e for instance e926c16d-12f3-4547-a52f-5056741e44a3 on hv-cinder-84893 Jul 14 11:18:00.861006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-c3675baf-6e51-49fb-aad5-a1ce10a50847 req-e1df12c3-a459-4f96-96df-7eb97ae02c7c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113074 Jul 14 11:18:00.865211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 443/882] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:18:00.926098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1407b38d-e438-4d9c-8d78-cfa49689ecbd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:00.927350 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1407b38d-e438-4d9c-8d78-cfa49689ecbd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:00.940861 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1407b38d-e438-4d9c-8d78-cfa49689ecbd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.941900 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1407b38d-e438-4d9c-8d78-cfa49689ecbd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:00.943899 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1407b38d-e438-4d9c-8d78-cfa49689ecbd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.944873 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1407b38d-e438-4d9c-8d78-cfa49689ecbd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:01.077036 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1407b38d-e438-4d9c-8d78-cfa49689ecbd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fffbf852ddc9455f8a68f80ad118e4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f04452d94114c64b9882cfa66e29479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:01.091757 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1407b38d-e438-4d9c-8d78-cfa49689ecbd tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 200 len: 1615 microversion: 2.1 time: 0.174575 Jul 14 11:18:01.102601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 440/883] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:00 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 1615 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:01.544943 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:01.546701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:01.560196 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:01.561647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:01.563377 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:01.564481 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:01.597277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] HTTP exception thrown: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Request method failure captured: Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 HTTP/1.1 Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_lyHKVyWpGESY9FMlsaOM8Xwie7_39taeBITeldUgAbWsiNuUknZySmYwjpXSIBapN6utcWksfwe07fbRNd56-ENzNdfHzffMLw3x1Y5ZOZ3yEW7x2MGzhyKe1wMKOdH2AfXengnUoiFh3pb_quV0uU3OgMo-txDYGDBkVCCGjvGWM Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:01.601434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a7cf89df79d64153a73a5ec4d49f376f", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 5a7c1a5f674c4dfbb969ac37c5102408 Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:01.602903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'e926c16d-12f3-4547-a52f-5056741e44a3'} Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:01.603768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:01.605677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:01.607089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Returning 404 to user: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:01.607089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fd0c608d-deb4-4e53-9746-38b45fd9fbb9 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 404 len: 111 microversion: 2.1 time: 0.068490 Jul 14 11:18:01.611412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 444/884] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:01 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:01.619803 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-46490880-ca88-47e6-8cfb-d24639a360c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '.version_select at 0x7f579de17700>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:01.643820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-46490880-ca88-47e6-8cfb-d24639a360c8 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178470685" status: 202 len: 0 microversion: 2.1 time: 0.027330 Jul 14 11:18:01.644795 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 441/885] 10.222.0.75 () {58 vars in 1217 bytes} [Thu Jul 14 11:18:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178470685 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:18:02.115121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:02.121126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:02.144227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:02.144642 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:02.146484 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:02.147682 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:02.183457 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 HTTP/1.1 Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:02.187227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:02.190780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'eae92658-6b4c-4f08-886d-9a0da70df211'} Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:02.192305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:02.194655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:02.200315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:02.200315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-68651665-73fa-4417-838a-013e81bbe29a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 404 len: 111 microversion: 2.1 time: 0.088493 Jul 14 11:18:02.200315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 445/886] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:02 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:18:02.212778 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0fa7dda9-d86a-4dc9-a57f-79af4ffcce0a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '.version_select at 0x7f579de45310>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:02.249437 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0fa7dda9-d86a-4dc9-a57f-79af4ffcce0a tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601687212" status: 202 len: 0 microversion: 2.1 time: 0.047060 Jul 14 11:18:02.250055 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 442/887] 10.222.0.75 () {58 vars in 1220 bytes} [Thu Jul 14 11:18:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601687212 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:18:02.891302 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-497080b7-e324-4e9d-89ad-82e7a8b7f61b req-28ffd061-c24b-46e1-8a47-827cf7b34973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae92658-6b4c-4f08-886d-9a0da70df211", "name": "network-vif-deleted", "tag": "fc6de59e-9654-4e10-9a58-7bd91197de9a"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:18:02.913349 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-497080b7-e324-4e9d-89ad-82e7a8b7f61b req-28ffd061-c24b-46e1-8a47-827cf7b34973 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:02.918994 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-497080b7-e324-4e9d-89ad-82e7a8b7f61b req-28ffd061-c24b-46e1-8a47-827cf7b34973 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:02.943829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-497080b7-e324-4e9d-89ad-82e7a8b7f61b req-28ffd061-c24b-46e1-8a47-827cf7b34973 service nova] Creating event network-vif-deleted:fc6de59e-9654-4e10-9a58-7bd91197de9a for instance eae92658-6b4c-4f08-886d-9a0da70df211 on hv-cinder-84893 Jul 14 11:18:02.953856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-497080b7-e324-4e9d-89ad-82e7a8b7f61b req-28ffd061-c24b-46e1-8a47-827cf7b34973 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070202 Jul 14 11:18:02.956368 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 446/888] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:18:04.616788 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:04.617585 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:04.625060 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:04.625523 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:04.626320 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:04.626756 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:04.642073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 HTTP/1.1 Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:18:04.644137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.646317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'eae92658-6b4c-4f08-886d-9a0da70df211'} Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:04.647686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.648959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.650264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:04.650264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-060587e8-4524-4388-9ea7-d7078558ae3e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 404 len: 111 microversion: 2.1 time: 0.034508 Jul 14 11:18:04.650264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 443/889] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:18:04 2022] DELETE /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:18:04.657297 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:04.658006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: eae92658-6b4c-4f08-886d-9a0da70df211] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:04.665325 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:04.665773 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:04.666563 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:04.667001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:04.683837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 HTTP/1.1 Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:04.685533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.687865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'eae92658-6b4c-4f08-886d-9a0da70df211'} Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:04.689698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. Jul 14 11:18:04.693001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:04.696179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance eae92658-6b4c-4f08-886d-9a0da70df211 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:04.696179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eb5318eb-42a4-4a72-9d08-2ca6ff3e9c95 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211" status: 404 len: 111 microversion: 2.1 time: 0.034509 Jul 14 11:18:04.696179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 447/890] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:04 2022] GET /compute/v2.1/servers/eae92658-6b4c-4f08-886d-9a0da70df211 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:05.142603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a7f37000-8e30-46e8-ab99-df73ac71006f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.143767 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a7f37000-8e30-46e8-ab99-df73ac71006f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.150464 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7f37000-8e30-46e8-ab99-df73ac71006f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.151188 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7f37000-8e30-46e8-ab99-df73ac71006f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.152438 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7f37000-8e30-46e8-ab99-df73ac71006f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.153356 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7f37000-8e30-46e8-ab99-df73ac71006f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.191785 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a7f37000-8e30-46e8-ab99-df73ac71006f tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053237 Jul 14 11:18:05.192898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 444/891] 10.222.0.75 () {60 vars in 1342 bytes} [Thu Jul 14 11:18:05 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:18:05.237900 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.238554 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.246302 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.246869 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.247945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.248637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.266951 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] HTTP exception thrown: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Request method failure captured: Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 HTTP/1.1 Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_lyHKVyWpGESY9FMlsaOM8Xwie7_39taeBITeldUgAbWsiNuUknZySmYwjpXSIBapN6utcWksfwe07fbRNd56-ENzNdfHzffMLw3x1Y5ZOZ3yEW7x2MGzhyKe1wMKOdH2AfXengnUoiFh3pb_quV0uU3OgMo-txDYGDBkVCCGjvGWM Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:05.269334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a7cf89df79d64153a73a5ec4d49f376f", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 5a7c1a5f674c4dfbb969ac37c5102408 Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.271870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'e926c16d-12f3-4547-a52f-5056741e44a3'} Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:05.273273 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.275542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.278358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Returning 404 to user: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:05.278358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3700b5a6-8b4e-480d-9630-6220d9d69845 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 404 len: 111 microversion: 2.1 time: 0.037997 Jul 14 11:18:05.278358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 448/892] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:18:05 2022] DELETE /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:05.278815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2be75ff3-8f7f-4945-b6ee-06edaa173062 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.278815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2be75ff3-8f7f-4945-b6ee-06edaa173062 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.282722 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.283630 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: e926c16d-12f3-4547-a52f-5056741e44a3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.285344 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2be75ff3-8f7f-4945-b6ee-06edaa173062 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.285932 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2be75ff3-8f7f-4945-b6ee-06edaa173062 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.286995 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2be75ff3-8f7f-4945-b6ee-06edaa173062 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.287593 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2be75ff3-8f7f-4945-b6ee-06edaa173062 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.292670 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.293463 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.294783 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.295359 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.312163 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] HTTP exception thrown: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Request method failure captured: Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 HTTP/1.1 Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_lyHKVyWpGESY9FMlsaOM8Xwie7_39taeBITeldUgAbWsiNuUknZySmYwjpXSIBapN6utcWksfwe07fbRNd56-ENzNdfHzffMLw3x1Y5ZOZ3yEW7x2MGzhyKe1wMKOdH2AfXengnUoiFh3pb_quV0uU3OgMo-txDYGDBkVCCGjvGWM Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:05.313974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a7cf89df79d64153a73a5ec4d49f376f", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 5a7c1a5f674c4dfbb969ac37c5102408 Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.316759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'e926c16d-12f3-4547-a52f-5056741e44a3'} Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:05.320527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. Jul 14 11:18:05.323749 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.326072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Returning 404 to user: Instance e926c16d-12f3-4547-a52f-5056741e44a3 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:05.326072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ac21fd5b-1155-4448-abbf-b45805613cb6 tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3" status: 404 len: 111 microversion: 2.1 time: 0.038966 Jul 14 11:18:05.327934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2be75ff3-8f7f-4945-b6ee-06edaa173062 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:18:05.328100 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 449/893] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:05 2022] GET /compute/v2.1/servers/e926c16d-12f3-4547-a52f-5056741e44a3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:05.444210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2be75ff3-8f7f-4945-b6ee-06edaa173062 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 204 len: 0 microversion: 2.20 time: 0.175656 Jul 14 11:18:05.450639 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 445/894] 10.222.0.75 () {60 vars in 1279 bytes} [Thu Jul 14 11:18:05 2022] DELETE /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 11:18:05.457824 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.458754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.467114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.467835 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.469142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.469679 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.677745 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:05.688258 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:05.689842 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:05.691083 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fa09ab62-9485-4f64-b0c5-1dcad8490aa3 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.238460 Jul 14 11:18:05.691708 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 450/895] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:05 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:18:05.857629 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.858324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.865600 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.866137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.867002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.867534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.883108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 HTTP/1.1 Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:18:05.885001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.886952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd5638369-b1e6-4b47-a77e-1e875bac6038'} Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:05.887947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.890177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.892617 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:05.892617 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9f16a69a-b7eb-4e1e-8013-1a8d2aae0939 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 404 len: 111 microversion: 2.1 time: 0.033517 Jul 14 11:18:05.892617 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 446/896] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:18:05 2022] DELETE /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:05.898856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.899682 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: d5638369-b1e6-4b47-a77e-1e875bac6038] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.906786 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.907237 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.908069 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.908508 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.926495 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 HTTP/1.1 Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:05.928138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.930610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'd5638369-b1e6-4b47-a77e-1e875bac6038'} Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:05.931717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. Jul 14 11:18:05.932926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.934685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance d5638369-b1e6-4b47-a77e-1e875bac6038 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:05.934685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f66f19cd-e5eb-4436-989c-39130a1a0e85 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038" status: 404 len: 111 microversion: 2.1 time: 0.035692 Jul 14 11:18:05.934685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 451/897] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:05 2022] GET /compute/v2.1/servers/d5638369-b1e6-4b47-a77e-1e875bac6038 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:18:05.940169 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.940804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.947741 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.948192 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.948971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.949422 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.966342 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 HTTP/1.1 Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:18:05.967973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:05.970387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6'} Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:05.972442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:05.974979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:05.977754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:05.977754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-799542fb-74a2-4f4a-9655-488af1771b70 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 404 len: 111 microversion: 2.1 time: 0.034018 Jul 14 11:18:05.977754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 447/898] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:18:05 2022] DELETE /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:05.984001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.985091 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.996458 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.997216 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.998589 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.999643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.019198 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 HTTP/1.1 Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:06.020813 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:06.023138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6'} Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:06.024419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. Jul 14 11:18:06.026559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.028999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:06.028999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a4477e90-723f-4e36-9a31-c989a3a15555 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6" status: 404 len: 111 microversion: 2.1 time: 0.045379 Jul 14 11:18:06.028999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 452/899] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:05 2022] GET /compute/v2.1/servers/e61cc47a-bbe4-49b8-83e5-cfa9e1a357e6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:18:06.543260 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:06.544188 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:06.552995 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.553859 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.554787 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.555323 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.571463 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] HTTP exception thrown: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Request method failure captured: Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d HTTP/1.1 Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_lyHKVyWpGESY9FMlsaOM8Xwie7_39taeBITeldUgAbWsiNuUknZySmYwjpXSIBapN6utcWksfwe07fbRNd56-ENzNdfHzffMLw3x1Y5ZOZ3yEW7x2MGzhyKe1wMKOdH2AfXengnUoiFh3pb_quV0uU3OgMo-txDYGDBkVCCGjvGWM Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:18:06.573202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a7cf89df79d64153a73a5ec4d49f376f", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 5a7c1a5f674c4dfbb969ac37c5102408 Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.574701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'aa194f91-d8c4-46f8-bbef-593b0e0fb64d'} Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:06.575492 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.578293 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.581944 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Returning 404 to user: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:06.581944 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88c5e949-beba-4a13-b676-1905cfb567af tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "DELETE /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 404 len: 111 microversion: 2.1 time: 0.039988 Jul 14 11:18:06.581944 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 448/900] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:18:06 2022] DELETE /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:06.586771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:06.587418 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] [instance: aa194f91-d8c4-46f8-bbef-593b0e0fb64d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:06.594539 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.595008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.595922 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.597132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.613417 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] HTTP exception thrown: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Request method failure captured: Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d HTTP/1.1 Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_lyHKVyWpGESY9FMlsaOM8Xwie7_39taeBITeldUgAbWsiNuUknZySmYwjpXSIBapN6utcWksfwe07fbRNd56-ENzNdfHzffMLw3x1Y5ZOZ3yEW7x2MGzhyKe1wMKOdH2AfXengnUoiFh3pb_quV0uU3OgMo-txDYGDBkVCCGjvGWM Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:06.615137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a7cf89df79d64153a73a5ec4d49f376f", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a7cf89df79d64153a73a5ec4d49f376f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: a7cf89df79d64153a73a5ec4d49f376f Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-618568205 Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 5a7c1a5f674c4dfbb969ac37c5102408 Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeTestJSON-618568205-project Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.622127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'aa194f91-d8c4-46f8-bbef-593b0e0fb64d'} Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:06.622844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. Jul 14 11:18:06.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:06.625900 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] Returning 404 to user: Instance aa194f91-d8c4-46f8-bbef-593b0e0fb64d could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:06.625900 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-665da725-cb5e-47bc-a688-7274af65481d tempest-AttachVolumeTestJSON-618568205 tempest-AttachVolumeTestJSON-618568205-project] 10.222.0.75 "GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d" status: 404 len: 111 microversion: 2.1 time: 0.034374 Jul 14 11:18:06.625900 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 453/901] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:06 2022] GET /compute/v2.1/servers/aa194f91-d8c4-46f8-bbef-593b0e0fb64d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:18:06.719141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:06.719971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:06.727670 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.728132 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.729177 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.729623 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.069276 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:07.084582 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:07.089442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:07.091966 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4f740117-b2b7-42f7-a046-80326071c9cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.376538 Jul 14 11:18:07.093410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 449/902] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:06 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:18:07.187709 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:07.188427 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:07.197471 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.197471 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.198094 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.198729 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.216717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a HTTP/1.1 Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:07.218518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.221038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '9966b0a3-56f9-486d-99ba-0e616d15167a'} Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:07.225205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.229779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.233772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:07.233772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ac894927-ca9a-4cae-a8c6-c57a8f735dc7 tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 404 len: 111 microversion: 2.1 time: 0.036957 Jul 14 11:18:07.233772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 454/903] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:18:07 2022] DELETE /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:07.234366 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:07.234366 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] [instance: 9966b0a3-56f9-486d-99ba-0e616d15167a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:07.239075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.239738 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.240380 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.240823 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.276414 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] HTTP exception thrown: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Request method failure captured: Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a HTTP/1.1 Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_js2IH9lb-6i_h9GtaPia81feNm9drJL0q2NRGBDDmHlP4hj9njvKb7fMkAIcbSN9eLPJvBW3w2mRteOh3rBgUw5YavmS7ZK7TpjnqjkCKclcR0L1noUsWyaJjWi36DtqD7V2NLuy1KIkF2G4v-G17uNnwqvgpInPu3xtY1ypa1xMg Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:18:07.279477 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7f04452d94114c64b9882cfa66e29479", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7f04452d94114c64b9882cfa66e29479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 7f04452d94114c64b9882cfa66e29479 Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424845745 Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: fffbf852ddc9455f8a68f80ad118e4d1 Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-1424845745-project Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.280819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '9966b0a3-56f9-486d-99ba-0e616d15167a'} Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:07.281579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. Jul 14 11:18:07.282762 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:07.284474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] Returning 404 to user: Instance 9966b0a3-56f9-486d-99ba-0e616d15167a could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:07.284474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9b5bfcb4-136a-4233-9039-6036390b442e tempest-AttachVolumeNegativeTest-1424845745 tempest-AttachVolumeNegativeTest-1424845745-project] 10.222.0.75 "GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a" status: 404 len: 111 microversion: 2.1 time: 0.055485 Jul 14 11:18:07.284474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 450/904] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:07 2022] GET /compute/v2.1/servers/9966b0a3-56f9-486d-99ba-0e616d15167a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:08.114737 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:08.115354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:08.122502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:08.123460 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:08.124545 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:08.125232 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:08.447016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:08.457428 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:08.459178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:08.460565 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7ee61e46-1c83-4f6f-afaf-0375f4ebd94a tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1723 microversion: 2.20 time: 0.350278 Jul 14 11:18:08.461142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 455/905] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:08 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:18:09.307718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d1271e15-e638-4c9c-ab8c-08e586b5d5a7 req-5717ddab-12db-4981-bbb2-217e240acb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431", "name": "network-vif-deleted", "tag": "6a60328d-ee1e-44d3-8008-6151b2c4427f"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:18:09.336334 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d1271e15-e638-4c9c-ab8c-08e586b5d5a7 req-5717ddab-12db-4981-bbb2-217e240acb0b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:09.336790 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d1271e15-e638-4c9c-ab8c-08e586b5d5a7 req-5717ddab-12db-4981-bbb2-217e240acb0b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:09.356292 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d1271e15-e638-4c9c-ab8c-08e586b5d5a7 req-5717ddab-12db-4981-bbb2-217e240acb0b service nova] Creating event network-vif-deleted:6a60328d-ee1e-44d3-8008-6151b2c4427f for instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 on hv-cinder-84893 Jul 14 11:18:09.362838 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d1271e15-e638-4c9c-ab8c-08e586b5d5a7 req-5717ddab-12db-4981-bbb2-217e240acb0b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059484 Jul 14 11:18:09.364196 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 451/906] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:18:09.490878 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:09.495079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:09.524844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:09.528429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:09.531942 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:09.536296 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:09.655178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:09.659408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:09.660206 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lazy-loading 'fault' on Instance uuid 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:18:09.771907 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:09.803220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:09.808045 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf3817e18de149aba43a2f65f37d63f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b56ea0be2964e21985deb5964232923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:09.810727 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a6eb855e-334e-49ba-8f5e-1e9dfcecefed tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 200 len: 1370 microversion: 2.20 time: 0.331343 Jul 14 11:18:09.812466 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 456/907] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:09 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 1370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:18:10.841335 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:10.844629 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:10.883610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:10.888934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:10.892067 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:10.893274 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:10.939036 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] HTTP exception thrown: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Request method failure captured: Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 HTTP/1.1 Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jxdiQ8lO3bza3KlvJ0I0L4MqWzwqsjqAltuSK13rRv6MXvOR-wVSYLK6oKJBFqtwx7YdkJPH7GHjwbKnGlQR4I3zeUEh6VW3ZPhqtkZcuGOiy5Bg-gkwFJvpQSGxw_JxTIPMwoyEFBCdVc7cG9pfIUmSHohpLAfBBVUvqz458vCOI Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:18:10.946040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9b56ea0be2964e21985deb5964232923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9b56ea0be2964e21985deb5964232923", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: bf3817e18de149aba43a2f65f37d63f4 Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:10.947667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431'} Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:10.948527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:10.949894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:10.951756 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Returning 404 to user: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:10.951756 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8f3aca6f-5e02-40e3-b152-361e76814ed5 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 404 len: 111 microversion: 2.20 time: 0.120049 Jul 14 11:18:10.951756 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 452/908] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:10 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:18:10.966648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-85a33630-d9bb-4d1d-a4ff-f5eb7df940e0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '.version_select at 0x7f579dde3040>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:11.012853 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-85a33630-d9bb-4d1d-a4ff-f5eb7df940e0 tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-979136228" status: 204 len: 0 microversion: 2.20 time: 0.056508 Jul 14 11:18:11.014726 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 457/909] 10.222.0.75 () {60 vars in 1258 bytes} [Thu Jul 14 11:18:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-979136228 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:18:13.438635 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:13.439319 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:13.447318 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:13.447884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:13.448777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:13.449288 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:13.467485 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] HTTP exception thrown: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Request method failure captured: Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 HTTP/1.1 Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jxdiQ8lO3bza3KlvJ0I0L4MqWzwqsjqAltuSK13rRv6MXvOR-wVSYLK6oKJBFqtwx7YdkJPH7GHjwbKnGlQR4I3zeUEh6VW3ZPhqtkZcuGOiy5Bg-gkwFJvpQSGxw_JxTIPMwoyEFBCdVc7cG9pfIUmSHohpLAfBBVUvqz458vCOI Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:18:13.469117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9b56ea0be2964e21985deb5964232923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9b56ea0be2964e21985deb5964232923", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: bf3817e18de149aba43a2f65f37d63f4 Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.470534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431'} Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:13.475028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.476566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.478573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Returning 404 to user: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:13.478573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bc3c9012-87fc-42ed-a466-e54438e86bdd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 404 len: 111 microversion: 2.20 time: 0.036156 Jul 14 11:18:13.478573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 453/910] 10.222.0.75 () {60 vars in 1279 bytes} [Thu Jul 14 11:18:13 2022] DELETE /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:18:13.488092 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:13.489633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:13.502220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:13.503050 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:13.504780 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:13.505833 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:13.533267 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] HTTP exception thrown: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Request method failure captured: Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 HTTP/1.1 Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_jxdiQ8lO3bza3KlvJ0I0L4MqWzwqsjqAltuSK13rRv6MXvOR-wVSYLK6oKJBFqtwx7YdkJPH7GHjwbKnGlQR4I3zeUEh6VW3ZPhqtkZcuGOiy5Bg-gkwFJvpQSGxw_JxTIPMwoyEFBCdVc7cG9pfIUmSHohpLAfBBVUvqz458vCOI Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:13.537503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9b56ea0be2964e21985deb5964232923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9b56ea0be2964e21985deb5964232923", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: bf3817e18de149aba43a2f65f37d63f4 Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.540654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431'} Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:13.542777 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. Jul 14 11:18:13.546868 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:13.556967 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Returning 404 to user: Instance 7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:13.556967 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bf10fa2a-6051-47b7-b38d-6a67866b48cd tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431" status: 404 len: 111 microversion: 2.20 time: 0.068057 Jul 14 11:18:13.556967 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 458/911] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:13 2022] GET /compute/v2.1/servers/7f69d9f2-87dd-44b7-a1ea-8b8daa3c6431 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:18:14.885824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:14.886547 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:14.907895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:14.909313 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:14.911244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:14.911803 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:14.945901 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] HTTP exception thrown: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Request method failure captured: Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 HTTP/1.1 Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_jxdiQ8lO3bza3KlvJ0I0L4MqWzwqsjqAltuSK13rRv6MXvOR-wVSYLK6oKJBFqtwx7YdkJPH7GHjwbKnGlQR4I3zeUEh6VW3ZPhqtkZcuGOiy5Bg-gkwFJvpQSGxw_JxTIPMwoyEFBCdVc7cG9pfIUmSHohpLAfBBVUvqz458vCOI Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:18:14.949627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9b56ea0be2964e21985deb5964232923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9b56ea0be2964e21985deb5964232923", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: bf3817e18de149aba43a2f65f37d63f4 Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:14.951364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '4d03bde1-0583-4099-8098-0077a2fc1084'} Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:14.952373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:14.953758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:18:14.958227 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Returning 404 to user: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:14.959945 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ebb1df4a-7e15-4133-8561-c150a423d81b tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "DELETE /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 404 len: 111 microversion: 2.20 time: 0.077934 Jul 14 11:18:14.963607 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 454/912] 10.222.0.75 () {60 vars in 1279 bytes} [Thu Jul 14 11:18:14 2022] DELETE /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:18:14.973152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:14.974192 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] [instance: 4d03bde1-0583-4099-8098-0077a2fc1084] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:14.984290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:14.985076 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:14.986474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:14.987714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:15.015837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] HTTP exception thrown: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Request method failure captured: Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 HTTP/1.1 Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_jxdiQ8lO3bza3KlvJ0I0L4MqWzwqsjqAltuSK13rRv6MXvOR-wVSYLK6oKJBFqtwx7YdkJPH7GHjwbKnGlQR4I3zeUEh6VW3ZPhqtkZcuGOiy5Bg-gkwFJvpQSGxw_JxTIPMwoyEFBCdVc7cG9pfIUmSHohpLAfBBVUvqz458vCOI Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:18:15.019204 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9b56ea0be2964e21985deb5964232923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9b56ea0be2964e21985deb5964232923", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b56ea0be2964e21985deb5964232923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 9b56ea0be2964e21985deb5964232923 Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1548731441 Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: bf3817e18de149aba43a2f65f37d63f4 Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1548731441-project Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:15.021095 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '4d03bde1-0583-4099-8098-0077a2fc1084'} Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:15.021979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. Jul 14 11:18:15.023333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:18:15.024766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] Returning 404 to user: Instance 4d03bde1-0583-4099-8098-0077a2fc1084 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:15.024766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f9160505-0609-47eb-8341-b1f613c4f94e tempest-AttachVolumeShelveTestJSON-1548731441 tempest-AttachVolumeShelveTestJSON-1548731441-project] 10.222.0.75 "GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084" status: 404 len: 111 microversion: 2.20 time: 0.053884 Jul 14 11:18:15.024766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 459/913] 10.222.0.75 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:14 2022] GET /compute/v2.1/servers/4d03bde1-0583-4099-8098-0077a2fc1084 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 11:19:12.109958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:19:12.112849 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:19:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:19:14.703553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f3e82518-079c-42dd-96ec-fc7b763253fd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Action: 'create', calling method: .version_select at 0x7f579de3a280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-485601796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVi34Iexi8JGThwEnpaFhO+HJ0EzqhvHW4RhTIHlMtfLt69c1PHEFwQQVeyc2y3dAzQwg2DLyU1lqfxRWhjR5Nl53Sh/1pnYALAl+Z2ruNv3XrFqDTdmmbQezLx6sFgDQ=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:14.714084 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:14.714875 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:14.729708 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f3e82518-079c-42dd-96ec-fc7b763253fd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Getting quotas for project 9b0b1b94221f442daa87ea1e3ca55df3. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:14.735532 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f3e82518-079c-42dd-96ec-fc7b763253fd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Getting quotas for user 677282eb944e45d0ae92991660551c4e and project 9b0b1b94221f442daa87ea1e3ca55df3. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:14.767915 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f3e82518-079c-42dd-96ec-fc7b763253fd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.069778 Jul 14 11:19:14.767915 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 455/914] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:19:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:15.004692 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1269024943", "imageRef": "3728fc2d-ed40-4c9e-a91c-4194a300d56e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-485601796", "networks": [{"uuid": "b225fb61-c46d-47c5-a71e-3174b9d9f4b6"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:15.022348 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:15.023189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=57 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:15.100221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] validate_networks() for [('b225fb61-c46d-47c5-a71e-3174b9d9f4b6', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:19:15.737818 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:19:15.738341 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:19:15.738827 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:19:15.739236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:19:15.739678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:19:15.756332 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:15.756804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:15.757595 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:15.758024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:15.779100 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Getting quotas for project 9b0b1b94221f442daa87ea1e3ca55df3. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:15.786953 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Getting quotas for user 677282eb944e45d0ae92991660551c4e and project 9b0b1b94221f442daa87ea1e3ca55df3. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:15.803858 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:19:15.806769 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3728fc2d-ed40-4c9e-a91c-4194a300d56e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:19:15.878587 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a83cb197-5d03-4bc4-8cd2-1aaa1af8e983 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883900 Jul 14 11:19:15.885981 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 460/915] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:19:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:19:15.897188 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-96c73a3b-66a5-48fd-a2db-0d7b4a632904 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:15.899428 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-96c73a3b-66a5-48fd-a2db-0d7b4a632904 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:16.012154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-96c73a3b-66a5-48fd-a2db-0d7b4a632904 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:16.029360 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-96c73a3b-66a5-48fd-a2db-0d7b4a632904 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1258 microversion: 2.1 time: 0.139187 Jul 14 11:19:16.031351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 456/916] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:15 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1258 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:17.059643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-671ddd16-cc32-429d-9e42-c913282f703f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:17.061135 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-671ddd16-cc32-429d-9e42-c913282f703f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:17.085697 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-671ddd16-cc32-429d-9e42-c913282f703f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:17.087874 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-671ddd16-cc32-429d-9e42-c913282f703f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:17.092332 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-671ddd16-cc32-429d-9e42-c913282f703f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:17.093576 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-671ddd16-cc32-429d-9e42-c913282f703f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:17.197804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-671ddd16-cc32-429d-9e42-c913282f703f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:17.211680 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-671ddd16-cc32-429d-9e42-c913282f703f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1310 microversion: 2.1 time: 0.155543 Jul 14 11:19:17.216798 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 461/917] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:17 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1310 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:18.228689 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-610b52cf-3fc4-4838-aadd-f1c2a8cf6e8f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:18.230883 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-610b52cf-3fc4-4838-aadd-f1c2a8cf6e8f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:18.255504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-610b52cf-3fc4-4838-aadd-f1c2a8cf6e8f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:18.257023 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-610b52cf-3fc4-4838-aadd-f1c2a8cf6e8f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:18.260106 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-610b52cf-3fc4-4838-aadd-f1c2a8cf6e8f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:18.261375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-610b52cf-3fc4-4838-aadd-f1c2a8cf6e8f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:18.429190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-610b52cf-3fc4-4838-aadd-f1c2a8cf6e8f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:18.464328 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-610b52cf-3fc4-4838-aadd-f1c2a8cf6e8f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1316 microversion: 2.1 time: 0.241794 Jul 14 11:19:18.466562 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 457/918] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:18 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:18.528971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:19:18.529548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Thu Jul 14 11:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:19:19.495311 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-691f21e7-2c90-4b9e-adc4-4c3c2ebd4bc7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:19.497290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-691f21e7-2c90-4b9e-adc4-4c3c2ebd4bc7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:19.511151 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-691f21e7-2c90-4b9e-adc4-4c3c2ebd4bc7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:19.511880 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-691f21e7-2c90-4b9e-adc4-4c3c2ebd4bc7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:19.513549 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-691f21e7-2c90-4b9e-adc4-4c3c2ebd4bc7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:19.514573 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-691f21e7-2c90-4b9e-adc4-4c3c2ebd4bc7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:19.755260 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-691f21e7-2c90-4b9e-adc4-4c3c2ebd4bc7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:19.767021 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-691f21e7-2c90-4b9e-adc4-4c3c2ebd4bc7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.278588 Jul 14 11:19:19.768288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 462/919] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:19 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:20.791210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e2714fe6-855d-443b-a4f4-d417d38bdb27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:20.792146 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e2714fe6-855d-443b-a4f4-d417d38bdb27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:20.800176 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2714fe6-855d-443b-a4f4-d417d38bdb27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:20.800641 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2714fe6-855d-443b-a4f4-d417d38bdb27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:20.801500 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2714fe6-855d-443b-a4f4-d417d38bdb27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:20.801954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2714fe6-855d-443b-a4f4-d417d38bdb27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:21.041700 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2714fe6-855d-443b-a4f4-d417d38bdb27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:21.062822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e2714fe6-855d-443b-a4f4-d417d38bdb27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.275699 Jul 14 11:19:21.073209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 458/920] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:20 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:21.101012 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1958753696", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "networks": [{"uuid": "57cccd21-e43b-4330-9949-ecb62e221d9b"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:21.182640 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] validate_networks() for [('57cccd21-e43b-4330-9949-ecb62e221d9b', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:19:21.661616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:19:21.662107 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:19:21.662734 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:19:21.663203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:19:21.663862 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:19:21.675310 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:21.676003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:21.677021 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:21.677705 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:21.703328 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Getting quotas for project 442d027d621e40e2800fd6467f2bb60d. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:21.709354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Getting quotas for user 831f85e5678248b6b2991b8ac3a5e2b6 and project 442d027d621e40e2800fd6467f2bb60d. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:21.724753 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:19:21.727222 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:19:21.785513 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0537d999-cb29-4c56-b447-cbee360a1839 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688380 Jul 14 11:19:21.786686 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 463/921] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:19:21.804706 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a2e3c3ea-0ff8-446e-80de-1fd62f2b7b6d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:21.806074 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a2e3c3ea-0ff8-446e-80de-1fd62f2b7b6d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:21.887194 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a2e3c3ea-0ff8-446e-80de-1fd62f2b7b6d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:21.896613 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a2e3c3ea-0ff8-446e-80de-1fd62f2b7b6d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1214 microversion: 2.1 time: 0.097416 Jul 14 11:19:21.896613 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 459/922] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:21 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:22.086249 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-98fc4103-94f7-4c57-83ee-6e093d8999eb tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:22.087195 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-98fc4103-94f7-4c57-83ee-6e093d8999eb tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:22.095437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98fc4103-94f7-4c57-83ee-6e093d8999eb tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:22.096540 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98fc4103-94f7-4c57-83ee-6e093d8999eb tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:22.097344 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98fc4103-94f7-4c57-83ee-6e093d8999eb tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:22.097775 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98fc4103-94f7-4c57-83ee-6e093d8999eb tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:22.394111 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-98fc4103-94f7-4c57-83ee-6e093d8999eb tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:22.406521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-98fc4103-94f7-4c57-83ee-6e093d8999eb tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.326601 Jul 14 11:19:22.411471 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 464/923] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:22 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:22.916229 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-be015429-9d30-48fe-aeaf-2caed1881270 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:22.918368 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-be015429-9d30-48fe-aeaf-2caed1881270 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:22.932501 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be015429-9d30-48fe-aeaf-2caed1881270 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:22.933763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be015429-9d30-48fe-aeaf-2caed1881270 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:22.935673 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be015429-9d30-48fe-aeaf-2caed1881270 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:22.936803 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be015429-9d30-48fe-aeaf-2caed1881270 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.037653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-be015429-9d30-48fe-aeaf-2caed1881270 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:23.051971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-be015429-9d30-48fe-aeaf-2caed1881270 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.142442 Jul 14 11:19:23.053073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 460/924] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:22 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:23.433621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d7866735-2e51-46f5-8b98-2a3ca7582e80 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:23.434548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d7866735-2e51-46f5-8b98-2a3ca7582e80 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:23.442798 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7866735-2e51-46f5-8b98-2a3ca7582e80 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.443262 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7866735-2e51-46f5-8b98-2a3ca7582e80 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.444098 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7866735-2e51-46f5-8b98-2a3ca7582e80 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.444748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7866735-2e51-46f5-8b98-2a3ca7582e80 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.689082 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d7866735-2e51-46f5-8b98-2a3ca7582e80 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:23.697610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d7866735-2e51-46f5-8b98-2a3ca7582e80 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.268646 Jul 14 11:19:23.698184 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 465/925] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:23 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:24.080305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a944b39a-21a7-4f19-8626-b9d367f7a80d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:24.080882 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a944b39a-21a7-4f19-8626-b9d367f7a80d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:24.088408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a944b39a-21a7-4f19-8626-b9d367f7a80d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.088883 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a944b39a-21a7-4f19-8626-b9d367f7a80d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.089673 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a944b39a-21a7-4f19-8626-b9d367f7a80d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.090117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a944b39a-21a7-4f19-8626-b9d367f7a80d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.166023 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a944b39a-21a7-4f19-8626-b9d367f7a80d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:24.175081 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a944b39a-21a7-4f19-8626-b9d367f7a80d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.098874 Jul 14 11:19:24.175722 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 461/926] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:24 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:24.716688 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3446aa6e-6d6f-4bc1-b553-917df87e38c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:24.717998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3446aa6e-6d6f-4bc1-b553-917df87e38c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:24.728999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3446aa6e-6d6f-4bc1-b553-917df87e38c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.729514 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3446aa6e-6d6f-4bc1-b553-917df87e38c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.730659 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3446aa6e-6d6f-4bc1-b553-917df87e38c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.731289 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3446aa6e-6d6f-4bc1-b553-917df87e38c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.945507 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3446aa6e-6d6f-4bc1-b553-917df87e38c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:24.960284 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3446aa6e-6d6f-4bc1-b553-917df87e38c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.247042 Jul 14 11:19:24.961719 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 466/927] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:24 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:25.197803 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d3837df-57fd-47c8-bd58-8603d220a211 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:25.199703 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9d3837df-57fd-47c8-bd58-8603d220a211 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:25.210351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d3837df-57fd-47c8-bd58-8603d220a211 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.212582 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d3837df-57fd-47c8-bd58-8603d220a211 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:25.214179 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d3837df-57fd-47c8-bd58-8603d220a211 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.215136 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d3837df-57fd-47c8-bd58-8603d220a211 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:25.350549 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d3837df-57fd-47c8-bd58-8603d220a211 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:25.365802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d3837df-57fd-47c8-bd58-8603d220a211 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.172964 Jul 14 11:19:25.366894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 462/928] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:25 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:25.983194 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8e5bd8f5-0e32-4738-a617-4301912da69e tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:25.985673 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8e5bd8f5-0e32-4738-a617-4301912da69e tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:25.997799 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e5bd8f5-0e32-4738-a617-4301912da69e tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.998472 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e5bd8f5-0e32-4738-a617-4301912da69e tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:25.999767 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e5bd8f5-0e32-4738-a617-4301912da69e tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.000301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e5bd8f5-0e32-4738-a617-4301912da69e tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.182805 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8e5bd8f5-0e32-4738-a617-4301912da69e tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:26.194014 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8e5bd8f5-0e32-4738-a617-4301912da69e tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.218672 Jul 14 11:19:26.194759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 467/929] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:25 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:26.397711 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32f92e9c-cd06-4fef-82a2-014f2864a639 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:26.398801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-32f92e9c-cd06-4fef-82a2-014f2864a639 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:26.407781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32f92e9c-cd06-4fef-82a2-014f2864a639 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.408797 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32f92e9c-cd06-4fef-82a2-014f2864a639 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.409650 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32f92e9c-cd06-4fef-82a2-014f2864a639 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.410125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32f92e9c-cd06-4fef-82a2-014f2864a639 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.516899 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-32f92e9c-cd06-4fef-82a2-014f2864a639 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:26.529666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-32f92e9c-cd06-4fef-82a2-014f2864a639 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.139203 Jul 14 11:19:26.530460 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 463/930] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:26 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:27.212931 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0670eb75-911e-465a-a79f-aa5a1f778c7d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:27.213623 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0670eb75-911e-465a-a79f-aa5a1f778c7d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:27.223127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0670eb75-911e-465a-a79f-aa5a1f778c7d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:27.223704 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0670eb75-911e-465a-a79f-aa5a1f778c7d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.224559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0670eb75-911e-465a-a79f-aa5a1f778c7d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:27.225003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0670eb75-911e-465a-a79f-aa5a1f778c7d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.379633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0670eb75-911e-465a-a79f-aa5a1f778c7d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:27.390651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0670eb75-911e-465a-a79f-aa5a1f778c7d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.181409 Jul 14 11:19:27.391412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 468/931] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:27 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:27.550011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ac3f694-f613-4dbd-8ef3-eeb203b35493 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:27.550907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4ac3f694-f613-4dbd-8ef3-eeb203b35493 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:27.558960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ac3f694-f613-4dbd-8ef3-eeb203b35493 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:27.559462 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ac3f694-f613-4dbd-8ef3-eeb203b35493 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.560372 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ac3f694-f613-4dbd-8ef3-eeb203b35493 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:27.560820 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ac3f694-f613-4dbd-8ef3-eeb203b35493 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.636801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ac3f694-f613-4dbd-8ef3-eeb203b35493 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:27.645326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4ac3f694-f613-4dbd-8ef3-eeb203b35493 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.100333 Jul 14 11:19:27.646088 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 464/932] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:27 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:28.413625 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9204d9a8-cedf-4a6d-b000-a3b21aa9112f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:28.414790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9204d9a8-cedf-4a6d-b000-a3b21aa9112f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:28.430553 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9204d9a8-cedf-4a6d-b000-a3b21aa9112f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.431336 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9204d9a8-cedf-4a6d-b000-a3b21aa9112f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.432754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9204d9a8-cedf-4a6d-b000-a3b21aa9112f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.433521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9204d9a8-cedf-4a6d-b000-a3b21aa9112f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.634067 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9204d9a8-cedf-4a6d-b000-a3b21aa9112f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:28.642189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9204d9a8-cedf-4a6d-b000-a3b21aa9112f tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.236099 Jul 14 11:19:28.642831 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 469/933] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:28 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:28.669491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ecd51b24-dda2-43c5-894f-9cfec3442372 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:28.671210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ecd51b24-dda2-43c5-894f-9cfec3442372 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:28.681037 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ecd51b24-dda2-43c5-894f-9cfec3442372 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.681777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ecd51b24-dda2-43c5-894f-9cfec3442372 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.682929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ecd51b24-dda2-43c5-894f-9cfec3442372 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.683370 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ecd51b24-dda2-43c5-894f-9cfec3442372 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.762424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ecd51b24-dda2-43c5-894f-9cfec3442372 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:28.775097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ecd51b24-dda2-43c5-894f-9cfec3442372 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.112806 Jul 14 11:19:28.775974 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 465/934] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:28 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:29.660477 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7dd33c2c-7b9b-4e87-9e13-7b469094dd15 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:29.661816 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7dd33c2c-7b9b-4e87-9e13-7b469094dd15 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:29.675224 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dd33c2c-7b9b-4e87-9e13-7b469094dd15 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.676214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dd33c2c-7b9b-4e87-9e13-7b469094dd15 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.677290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dd33c2c-7b9b-4e87-9e13-7b469094dd15 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.677752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dd33c2c-7b9b-4e87-9e13-7b469094dd15 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.793360 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6c8b0008-3dd1-4862-8252-d4bfbd2c11e3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:29.794228 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6c8b0008-3dd1-4862-8252-d4bfbd2c11e3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:29.801599 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c8b0008-3dd1-4862-8252-d4bfbd2c11e3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.802125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c8b0008-3dd1-4862-8252-d4bfbd2c11e3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.803208 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c8b0008-3dd1-4862-8252-d4bfbd2c11e3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.803667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c8b0008-3dd1-4862-8252-d4bfbd2c11e3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.852660 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7dd33c2c-7b9b-4e87-9e13-7b469094dd15 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:29.864479 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7dd33c2c-7b9b-4e87-9e13-7b469094dd15 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.208012 Jul 14 11:19:29.866110 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 470/935] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:29 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:29.876401 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6c8b0008-3dd1-4862-8252-d4bfbd2c11e3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:29.888062 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6c8b0008-3dd1-4862-8252-d4bfbd2c11e3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.098044 Jul 14 11:19:29.889106 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 466/936] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:29 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:30.886307 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bb264811-81f2-4ecf-927d-f19936e544a8 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:30.887304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bb264811-81f2-4ecf-927d-f19936e544a8 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:30.901885 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bb264811-81f2-4ecf-927d-f19936e544a8 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.902329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bb264811-81f2-4ecf-927d-f19936e544a8 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.903294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bb264811-81f2-4ecf-927d-f19936e544a8 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.903923 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bb264811-81f2-4ecf-927d-f19936e544a8 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.912818 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e64f2771-b503-406a-aff9-6c1f3233a047 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:30.914244 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e64f2771-b503-406a-aff9-6c1f3233a047 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:30.941351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e64f2771-b503-406a-aff9-6c1f3233a047 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.942214 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e64f2771-b503-406a-aff9-6c1f3233a047 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.943973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e64f2771-b503-406a-aff9-6c1f3233a047 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.945292 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e64f2771-b503-406a-aff9-6c1f3233a047 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:31.030867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e64f2771-b503-406a-aff9-6c1f3233a047 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:31.047119 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e64f2771-b503-406a-aff9-6c1f3233a047 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.144313 Jul 14 11:19:31.048180 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 467/937] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:30 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:31.145059 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bb264811-81f2-4ecf-927d-f19936e544a8 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:31.152929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bb264811-81f2-4ecf-927d-f19936e544a8 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.272315 Jul 14 11:19:31.153514 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 471/938] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:30 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:31.378674 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-5542bb4b-95d6-406f-bdc3-3a1ba60f2649 req-f8cfa0ed-d9ce-4874-9880-360b94a86e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6289419-08d9-4d3f-8178-fe2612830f3c", "tag": "eae020e3-68cc-41b2-b34f-a030ba6e139b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:31.387575 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5542bb4b-95d6-406f-bdc3-3a1ba60f2649 req-f8cfa0ed-d9ce-4874-9880-360b94a86e09 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:31.388024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5542bb4b-95d6-406f-bdc3-3a1ba60f2649 req-f8cfa0ed-d9ce-4874-9880-360b94a86e09 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:31.402536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-5542bb4b-95d6-406f-bdc3-3a1ba60f2649 req-f8cfa0ed-d9ce-4874-9880-360b94a86e09 service nova] Creating event network-changed:eae020e3-68cc-41b2-b34f-a030ba6e139b for instance f6289419-08d9-4d3f-8178-fe2612830f3c on hv-cinder-84893 Jul 14 11:19:31.408576 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-5542bb4b-95d6-406f-bdc3-3a1ba60f2649 req-f8cfa0ed-d9ce-4874-9880-360b94a86e09 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171315 Jul 14 11:19:31.409508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 468/939] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:32.065969 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9c9ff45c-b4ba-49e6-92e0-32bd1e5eabc7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:32.066588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9c9ff45c-b4ba-49e6-92e0-32bd1e5eabc7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:32.068800 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:32.069593 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=12 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:32.076597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c9ff45c-b4ba-49e6-92e0-32bd1e5eabc7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.077045 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c9ff45c-b4ba-49e6-92e0-32bd1e5eabc7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.077828 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c9ff45c-b4ba-49e6-92e0-32bd1e5eabc7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.078264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c9ff45c-b4ba-49e6-92e0-32bd1e5eabc7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.168053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=8 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:32.173345 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d7632510-7ee2-4b54-8280-7d283b2ffeda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:32.174716 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d7632510-7ee2-4b54-8280-7d283b2ffeda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:32.182064 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7632510-7ee2-4b54-8280-7d283b2ffeda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.182516 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7632510-7ee2-4b54-8280-7d283b2ffeda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.183308 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7632510-7ee2-4b54-8280-7d283b2ffeda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.183767 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7632510-7ee2-4b54-8280-7d283b2ffeda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.340927 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d7632510-7ee2-4b54-8280-7d283b2ffeda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:32.349693 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d7632510-7ee2-4b54-8280-7d283b2ffeda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.182542 Jul 14 11:19:32.350294 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 469/940] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:32 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:32.440543 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9c9ff45c-b4ba-49e6-92e0-32bd1e5eabc7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:32.448363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9c9ff45c-b4ba-49e6-92e0-32bd1e5eabc7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.386947 Jul 14 11:19:32.448960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 472/941] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:32 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:33.367301 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e53d8135-b870-4d8f-9732-0e976c5748c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:33.367952 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e53d8135-b870-4d8f-9732-0e976c5748c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:33.375070 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e53d8135-b870-4d8f-9732-0e976c5748c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.375556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e53d8135-b870-4d8f-9732-0e976c5748c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.376339 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e53d8135-b870-4d8f-9732-0e976c5748c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.377381 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e53d8135-b870-4d8f-9732-0e976c5748c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.466126 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8542148c-42c7-47e9-8106-d2c878e99b39 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:33.466732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8542148c-42c7-47e9-8106-d2c878e99b39 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:33.473323 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8542148c-42c7-47e9-8106-d2c878e99b39 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.473950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8542148c-42c7-47e9-8106-d2c878e99b39 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.474859 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8542148c-42c7-47e9-8106-d2c878e99b39 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.475420 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8542148c-42c7-47e9-8106-d2c878e99b39 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.517637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e53d8135-b870-4d8f-9732-0e976c5748c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:33.525398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e53d8135-b870-4d8f-9732-0e976c5748c7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.162100 Jul 14 11:19:33.526002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 470/942] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:33 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:33.544508 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8542148c-42c7-47e9-8106-d2c878e99b39 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:33.552896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8542148c-42c7-47e9-8106-d2c878e99b39 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1218 microversion: 2.1 time: 0.090702 Jul 14 11:19:33.553486 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 473/943] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:33 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:34.542419 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-049fd900-83c6-490e-81fd-7017dc9171ba tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:34.542983 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-049fd900-83c6-490e-81fd-7017dc9171ba tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:34.550051 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-049fd900-83c6-490e-81fd-7017dc9171ba tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.550503 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-049fd900-83c6-490e-81fd-7017dc9171ba tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.551302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-049fd900-83c6-490e-81fd-7017dc9171ba tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.551773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-049fd900-83c6-490e-81fd-7017dc9171ba tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.572022 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1b768a0d-6cbe-4e0d-b2de-328dd16fed0d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:34.572658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1b768a0d-6cbe-4e0d-b2de-328dd16fed0d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:34.580852 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b768a0d-6cbe-4e0d-b2de-328dd16fed0d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.581822 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b768a0d-6cbe-4e0d-b2de-328dd16fed0d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.584358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b768a0d-6cbe-4e0d-b2de-328dd16fed0d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.586977 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1b768a0d-6cbe-4e0d-b2de-328dd16fed0d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.655138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1b768a0d-6cbe-4e0d-b2de-328dd16fed0d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:34.664050 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1b768a0d-6cbe-4e0d-b2de-328dd16fed0d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1274 microversion: 2.1 time: 0.095919 Jul 14 11:19:34.673736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 474/944] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:34 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:34.718110 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-049fd900-83c6-490e-81fd-7017dc9171ba tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:34.738099 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-049fd900-83c6-490e-81fd-7017dc9171ba tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.199614 Jul 14 11:19:34.745313 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 471/945] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:34 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:35.681653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0595aff2-ce31-45c0-ab2e-8a6cc8524ea0 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:35.682290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0595aff2-ce31-45c0-ab2e-8a6cc8524ea0 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:35.688802 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0595aff2-ce31-45c0-ab2e-8a6cc8524ea0 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.689253 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0595aff2-ce31-45c0-ab2e-8a6cc8524ea0 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.690029 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0595aff2-ce31-45c0-ab2e-8a6cc8524ea0 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.690467 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0595aff2-ce31-45c0-ab2e-8a6cc8524ea0 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.759958 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3bb99b08-f7f7-414a-8fd0-79478c8b48c2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:35.760566 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3bb99b08-f7f7-414a-8fd0-79478c8b48c2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:35.768097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3bb99b08-f7f7-414a-8fd0-79478c8b48c2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.768358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3bb99b08-f7f7-414a-8fd0-79478c8b48c2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.769425 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3bb99b08-f7f7-414a-8fd0-79478c8b48c2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.770173 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3bb99b08-f7f7-414a-8fd0-79478c8b48c2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.770852 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0595aff2-ce31-45c0-ab2e-8a6cc8524ea0 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:35.780792 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0595aff2-ce31-45c0-ab2e-8a6cc8524ea0 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1272 microversion: 2.1 time: 0.103268 Jul 14 11:19:35.782465 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 475/946] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:35 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:35.914874 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3bb99b08-f7f7-414a-8fd0-79478c8b48c2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:35.924351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3bb99b08-f7f7-414a-8fd0-79478c8b48c2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.167547 Jul 14 11:19:35.924936 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 472/947] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:35 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:36.801409 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-af62ca88-34ed-4586-b2fc-60641fa28942 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:36.802010 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-af62ca88-34ed-4586-b2fc-60641fa28942 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:36.808690 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-af62ca88-34ed-4586-b2fc-60641fa28942 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.809134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-af62ca88-34ed-4586-b2fc-60641fa28942 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.809884 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-af62ca88-34ed-4586-b2fc-60641fa28942 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.810313 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-af62ca88-34ed-4586-b2fc-60641fa28942 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.942185 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-69cf15dc-40e8-4faf-bf80-2f96ee38aed0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:36.943046 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-69cf15dc-40e8-4faf-bf80-2f96ee38aed0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:36.945227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-af62ca88-34ed-4586-b2fc-60641fa28942 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:36.949594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-69cf15dc-40e8-4faf-bf80-2f96ee38aed0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.950044 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-69cf15dc-40e8-4faf-bf80-2f96ee38aed0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.950813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-69cf15dc-40e8-4faf-bf80-2f96ee38aed0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.951251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-69cf15dc-40e8-4faf-bf80-2f96ee38aed0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.952714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-af62ca88-34ed-4586-b2fc-60641fa28942 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1314 microversion: 2.1 time: 0.155773 Jul 14 11:19:36.953309 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 476/948] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:36 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:37.087993 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-69cf15dc-40e8-4faf-bf80-2f96ee38aed0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:37.095709 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-69cf15dc-40e8-4faf-bf80-2f96ee38aed0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.157831 Jul 14 11:19:37.096285 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 473/949] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:36 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:38.026713 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-152d140b-0c5c-4837-844e-996d6fba5d58 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:38.027439 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-152d140b-0c5c-4837-844e-996d6fba5d58 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:38.035187 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-152d140b-0c5c-4837-844e-996d6fba5d58 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.035688 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-152d140b-0c5c-4837-844e-996d6fba5d58 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.036521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-152d140b-0c5c-4837-844e-996d6fba5d58 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.037203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-152d140b-0c5c-4837-844e-996d6fba5d58 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.113036 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb999a22-c0bb-43ba-b0d0-c5c37430dfc2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:38.114068 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fb999a22-c0bb-43ba-b0d0-c5c37430dfc2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:38.122961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb999a22-c0bb-43ba-b0d0-c5c37430dfc2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.123436 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb999a22-c0bb-43ba-b0d0-c5c37430dfc2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.124251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb999a22-c0bb-43ba-b0d0-c5c37430dfc2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.124689 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb999a22-c0bb-43ba-b0d0-c5c37430dfc2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.261407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fb999a22-c0bb-43ba-b0d0-c5c37430dfc2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:38.268908 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb999a22-c0bb-43ba-b0d0-c5c37430dfc2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.160874 Jul 14 11:19:38.269488 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 474/950] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:38 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:38.275212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-152d140b-0c5c-4837-844e-996d6fba5d58 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:38.278874 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:38.284346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-152d140b-0c5c-4837-844e-996d6fba5d58 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1314 microversion: 2.1 time: 0.261734 Jul 14 11:19:38.284919 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 477/951] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:38 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:38.636334 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-291a31a7-9370-4720-8501-1842cabd509c req-c9e026c8-07e1-48d2-88fe-c2d337b305cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f029b310-6a6f-4a03-9f30-904c4197bfb9", "tag": "c0c707e9-11f3-4820-bb25-dd5d2c4cdaca"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:38.650601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-291a31a7-9370-4720-8501-1842cabd509c req-c9e026c8-07e1-48d2-88fe-c2d337b305cf service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.651047 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-291a31a7-9370-4720-8501-1842cabd509c req-c9e026c8-07e1-48d2-88fe-c2d337b305cf service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.655410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:38.674788 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-291a31a7-9370-4720-8501-1842cabd509c req-c9e026c8-07e1-48d2-88fe-c2d337b305cf service nova] Creating event network-changed:c0c707e9-11f3-4820-bb25-dd5d2c4cdaca for instance f029b310-6a6f-4a03-9f30-904c4197bfb9 on hv-cinder-84893 Jul 14 11:19:38.680328 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-291a31a7-9370-4720-8501-1842cabd509c req-c9e026c8-07e1-48d2-88fe-c2d337b305cf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047807 Jul 14 11:19:38.681691 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 475/952] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:39.286870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2bb806ac-8c49-42de-8339-192a4fb21a42 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:39.287440 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2bb806ac-8c49-42de-8339-192a4fb21a42 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:39.294168 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2bb806ac-8c49-42de-8339-192a4fb21a42 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:39.294648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2bb806ac-8c49-42de-8339-192a4fb21a42 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.295409 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2bb806ac-8c49-42de-8339-192a4fb21a42 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:39.295853 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2bb806ac-8c49-42de-8339-192a4fb21a42 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.302908 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-772d3ab9-1a24-4724-a6cb-1d67260df85c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:39.303771 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-772d3ab9-1a24-4724-a6cb-1d67260df85c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:39.310333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-772d3ab9-1a24-4724-a6cb-1d67260df85c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:39.310770 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-772d3ab9-1a24-4724-a6cb-1d67260df85c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.311576 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-772d3ab9-1a24-4724-a6cb-1d67260df85c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:39.312009 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-772d3ab9-1a24-4724-a6cb-1d67260df85c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.433123 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2bb806ac-8c49-42de-8339-192a4fb21a42 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:39.441559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2bb806ac-8c49-42de-8339-192a4fb21a42 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.158530 Jul 14 11:19:39.442221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 478/953] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:39 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:39.450166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-772d3ab9-1a24-4724-a6cb-1d67260df85c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:39.458331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-772d3ab9-1a24-4724-a6cb-1d67260df85c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1314 microversion: 2.1 time: 0.160587 Jul 14 11:19:39.458903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 476/954] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:39 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:40.461124 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cf4955de-e27b-43aa-9a83-ed62e2b420d2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:40.461884 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cf4955de-e27b-43aa-9a83-ed62e2b420d2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:40.476189 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef006945-0e3c-44bc-a6a6-ef198db735be tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:40.476852 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef006945-0e3c-44bc-a6a6-ef198db735be tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:40.479442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf4955de-e27b-43aa-9a83-ed62e2b420d2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.480462 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf4955de-e27b-43aa-9a83-ed62e2b420d2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.481354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf4955de-e27b-43aa-9a83-ed62e2b420d2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.481957 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf4955de-e27b-43aa-9a83-ed62e2b420d2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.492303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef006945-0e3c-44bc-a6a6-ef198db735be tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.492747 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef006945-0e3c-44bc-a6a6-ef198db735be tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.493526 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef006945-0e3c-44bc-a6a6-ef198db735be tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.493957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef006945-0e3c-44bc-a6a6-ef198db735be tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.684859 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cf4955de-e27b-43aa-9a83-ed62e2b420d2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:40.685786 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ef006945-0e3c-44bc-a6a6-ef198db735be tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:40.695312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ef006945-0e3c-44bc-a6a6-ef198db735be tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1314 microversion: 2.1 time: 0.223793 Jul 14 11:19:40.695616 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cf4955de-e27b-43aa-9a83-ed62e2b420d2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.240984 Jul 14 11:19:40.696766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 479/955] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:40 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:40.697011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 477/956] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:40 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:41.045183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-5e89e4ce-1058-43be-91ec-f47c903d9512 req-2cf5df3a-ac8b-4f79-8a22-57961f0c9ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6289419-08d9-4d3f-8178-fe2612830f3c", "name": "network-vif-plugged", "status": "completed", "tag": "eae020e3-68cc-41b2-b34f-a030ba6e139b"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:41.054794 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5e89e4ce-1058-43be-91ec-f47c903d9512 req-2cf5df3a-ac8b-4f79-8a22-57961f0c9ddd service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.055238 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5e89e4ce-1058-43be-91ec-f47c903d9512 req-2cf5df3a-ac8b-4f79-8a22-57961f0c9ddd service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.068521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-5e89e4ce-1058-43be-91ec-f47c903d9512 req-2cf5df3a-ac8b-4f79-8a22-57961f0c9ddd service nova] Creating event network-vif-plugged:eae020e3-68cc-41b2-b34f-a030ba6e139b for instance f6289419-08d9-4d3f-8178-fe2612830f3c on hv-cinder-84893 Jul 14 11:19:41.073755 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-5e89e4ce-1058-43be-91ec-f47c903d9512 req-2cf5df3a-ac8b-4f79-8a22-57961f0c9ddd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256479 Jul 14 11:19:41.074364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 480/957] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:41.716422 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4f1c1438-de90-4d4a-9384-d485f44fbc5a tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:41.717695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4f1c1438-de90-4d4a-9384-d485f44fbc5a tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:41.717910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2c4f86e5-b45e-4bb1-b131-58f967294728 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:41.719069 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2c4f86e5-b45e-4bb1-b131-58f967294728 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:41.730572 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c4f86e5-b45e-4bb1-b131-58f967294728 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.730998 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f1c1438-de90-4d4a-9384-d485f44fbc5a tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.731948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f1c1438-de90-4d4a-9384-d485f44fbc5a tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.732290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c4f86e5-b45e-4bb1-b131-58f967294728 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.733458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f1c1438-de90-4d4a-9384-d485f44fbc5a tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.734189 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f1c1438-de90-4d4a-9384-d485f44fbc5a tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.734548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c4f86e5-b45e-4bb1-b131-58f967294728 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.736692 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c4f86e5-b45e-4bb1-b131-58f967294728 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.908891 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4f1c1438-de90-4d4a-9384-d485f44fbc5a tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:41.916809 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4f1c1438-de90-4d4a-9384-d485f44fbc5a tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1314 microversion: 2.1 time: 0.208220 Jul 14 11:19:41.917391 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 478/958] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:41 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:41.922866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2c4f86e5-b45e-4bb1-b131-58f967294728 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:41.930936 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2c4f86e5-b45e-4bb1-b131-58f967294728 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.221190 Jul 14 11:19:41.931456 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 481/959] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:41 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:42.934599 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1bfb85c8-f325-406e-9b60-00d232882155 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:42.935329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1bfb85c8-f325-406e-9b60-00d232882155 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:42.942896 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bfb85c8-f325-406e-9b60-00d232882155 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:42.943351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bfb85c8-f325-406e-9b60-00d232882155 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:42.944162 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bfb85c8-f325-406e-9b60-00d232882155 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:42.944602 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bfb85c8-f325-406e-9b60-00d232882155 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:42.948580 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3b61b86a-0df6-402e-9a6c-1190c244a219 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:42.949188 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3b61b86a-0df6-402e-9a6c-1190c244a219 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:42.956852 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b61b86a-0df6-402e-9a6c-1190c244a219 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:42.957473 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b61b86a-0df6-402e-9a6c-1190c244a219 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:42.958255 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b61b86a-0df6-402e-9a6c-1190c244a219 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:42.958727 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b61b86a-0df6-402e-9a6c-1190c244a219 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:43.097054 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1bfb85c8-f325-406e-9b60-00d232882155 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:43.104157 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1bfb85c8-f325-406e-9b60-00d232882155 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1314 microversion: 2.1 time: 0.174032 Jul 14 11:19:43.104749 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 479/960] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:42 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:43.138826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3b61b86a-0df6-402e-9a6c-1190c244a219 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:43.147079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3b61b86a-0df6-402e-9a6c-1190c244a219 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1358 microversion: 2.1 time: 0.202586 Jul 14 11:19:43.147828 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 482/961] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:42 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:44.121257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e87f6d78-f7aa-4128-8b2d-d705de5cab68 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:44.121863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e87f6d78-f7aa-4128-8b2d-d705de5cab68 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:44.128805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e87f6d78-f7aa-4128-8b2d-d705de5cab68 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.129254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e87f6d78-f7aa-4128-8b2d-d705de5cab68 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.130016 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e87f6d78-f7aa-4128-8b2d-d705de5cab68 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.130452 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e87f6d78-f7aa-4128-8b2d-d705de5cab68 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.164244 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-10b77030-532a-410f-8744-c31588fb74dd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:44.164974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-10b77030-532a-410f-8744-c31588fb74dd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:44.171679 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-10b77030-532a-410f-8744-c31588fb74dd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.172134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-10b77030-532a-410f-8744-c31588fb74dd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.173030 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-10b77030-532a-410f-8744-c31588fb74dd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.173405 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-10b77030-532a-410f-8744-c31588fb74dd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.276178 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e87f6d78-f7aa-4128-8b2d-d705de5cab68 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:44.283668 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e87f6d78-f7aa-4128-8b2d-d705de5cab68 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1314 microversion: 2.1 time: 0.166354 Jul 14 11:19:44.284246 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 480/962] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:44 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:44.313622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-10b77030-532a-410f-8744-c31588fb74dd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:44.321540 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-10b77030-532a-410f-8744-c31588fb74dd tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1548 microversion: 2.1 time: 0.161174 Jul 14 11:19:44.322102 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 483/963] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:44 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:44.338060 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b85f2173-33e0-499d-9c33-9a9bd9452dda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:44.338659 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b85f2173-33e0-499d-9c33-9a9bd9452dda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:44.344959 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b85f2173-33e0-499d-9c33-9a9bd9452dda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.345408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b85f2173-33e0-499d-9c33-9a9bd9452dda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.346211 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b85f2173-33e0-499d-9c33-9a9bd9452dda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.346596 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b85f2173-33e0-499d-9c33-9a9bd9452dda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.495462 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b85f2173-33e0-499d-9c33-9a9bd9452dda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:44.503870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b85f2173-33e0-499d-9c33-9a9bd9452dda tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1548 microversion: 2.1 time: 0.169616 Jul 14 11:19:44.504456 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 481/964] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:44 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:44.520226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:44.523839 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:44.524626 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Searching by: {'deleted': False, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3'} {{(pid=117888) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 11:19:44.532519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.532937 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.533786 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.534228 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.636708 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.multi_cell_list [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117888) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 11:19:44.736953 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6ac32a42-134b-43fd-9bbf-7cf8344b5de4 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.220126 Jul 14 11:19:44.737768 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 484/965] 10.222.0.75 () {58 vars in 1124 bytes} [Thu Jul 14 11:19:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:44.748088 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5868c0d5-dd3c-41aa-a894-817d03d6cdc9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:44.748695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5868c0d5-dd3c-41aa-a894-817d03d6cdc9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:44.750695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:44.757877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5868c0d5-dd3c-41aa-a894-817d03d6cdc9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.758902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5868c0d5-dd3c-41aa-a894-817d03d6cdc9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.760634 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5868c0d5-dd3c-41aa-a894-817d03d6cdc9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.761573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5868c0d5-dd3c-41aa-a894-817d03d6cdc9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.774882 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-f19b1c9d-9c33-47c7-8796-62741df5fa2c req-4da7026d-80a8-4636-825e-abf02b6b0078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f029b310-6a6f-4a03-9f30-904c4197bfb9", "name": "network-vif-plugged", "status": "completed", "tag": "c0c707e9-11f3-4820-bb25-dd5d2c4cdaca"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:44.785578 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-f19b1c9d-9c33-47c7-8796-62741df5fa2c req-4da7026d-80a8-4636-825e-abf02b6b0078 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.786120 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-f19b1c9d-9c33-47c7-8796-62741df5fa2c req-4da7026d-80a8-4636-825e-abf02b6b0078 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.799614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-f19b1c9d-9c33-47c7-8796-62741df5fa2c req-4da7026d-80a8-4636-825e-abf02b6b0078 service nova] Creating event network-vif-plugged:c0c707e9-11f3-4820-bb25-dd5d2c4cdaca for instance f029b310-6a6f-4a03-9f30-904c4197bfb9 on hv-cinder-84893 Jul 14 11:19:44.807595 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-f19b1c9d-9c33-47c7-8796-62741df5fa2c req-4da7026d-80a8-4636-825e-abf02b6b0078 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035811 Jul 14 11:19:44.808753 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 485/966] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:19:45.077997 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5868c0d5-dd3c-41aa-a894-817d03d6cdc9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:45.086378 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5868c0d5-dd3c-41aa-a894-817d03d6cdc9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1548 microversion: 2.1 time: 0.342237 Jul 14 11:19:45.086971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 482/967] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:44 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1548 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:45.302088 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-baf865b0-4c76-4dff-9b34-c2649b30c876 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:45.302923 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-baf865b0-4c76-4dff-9b34-c2649b30c876 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:45.304898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:45.311405 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baf865b0-4c76-4dff-9b34-c2649b30c876 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:45.311853 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baf865b0-4c76-4dff-9b34-c2649b30c876 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:45.312622 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baf865b0-4c76-4dff-9b34-c2649b30c876 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:45.313055 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baf865b0-4c76-4dff-9b34-c2649b30c876 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:45.477816 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-baf865b0-4c76-4dff-9b34-c2649b30c876 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:45.486488 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-baf865b0-4c76-4dff-9b34-c2649b30c876 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1314 microversion: 2.1 time: 0.189257 Jul 14 11:19:45.487567 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 486/968] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:45 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:46.505691 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70ad3a4f-9b96-4450-bf36-422626b86dfa tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:46.506302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-70ad3a4f-9b96-4450-bf36-422626b86dfa tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:46.513389 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ad3a4f-9b96-4450-bf36-422626b86dfa tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:46.513851 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ad3a4f-9b96-4450-bf36-422626b86dfa tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:46.514631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ad3a4f-9b96-4450-bf36-422626b86dfa tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:46.515115 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ad3a4f-9b96-4450-bf36-422626b86dfa tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:46.656680 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-406d7671-ecb4-4c59-9c66-4539f7e4ea66 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "855288c2-8f54-4b76-a418-b7f338a42680"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:46.658932 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-70ad3a4f-9b96-4450-bf36-422626b86dfa tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:46.659571 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-406d7671-ecb4-4c59-9c66-4539f7e4ea66 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:46.667071 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-70ad3a4f-9b96-4450-bf36-422626b86dfa tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1499 microversion: 2.1 time: 0.165784 Jul 14 11:19:46.667686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 483/969] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:46 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:46.667848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-406d7671-ecb4-4c59-9c66-4539f7e4ea66 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:46.668217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-406d7671-ecb4-4c59-9c66-4539f7e4ea66 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:46.669122 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-406d7671-ecb4-4c59-9c66-4539f7e4ea66 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:46.669451 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-406d7671-ecb4-4c59-9c66-4539f7e4ea66 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.235171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-406d7671-ecb4-4c59-9c66-4539f7e4ea66 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "POST /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582480 Jul 14 11:19:47.235814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 487/970] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:19:46 2022] POST /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:19:47.258831 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4354b0a7-5253-42b9-8a42-3ffa09e432c7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:47.259356 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4354b0a7-5253-42b9-8a42-3ffa09e432c7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:47.265638 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4354b0a7-5253-42b9-8a42-3ffa09e432c7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:47.266089 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4354b0a7-5253-42b9-8a42-3ffa09e432c7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.266860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4354b0a7-5253-42b9-8a42-3ffa09e432c7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:47.267294 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4354b0a7-5253-42b9-8a42-3ffa09e432c7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.294667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4354b0a7-5253-42b9-8a42-3ffa09e432c7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:19:47.400073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4354b0a7-5253-42b9-8a42-3ffa09e432c7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 204 len: 0 microversion: 2.1 time: 0.144398 Jul 14 11:19:47.401070 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 484/971] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:19:47 2022] DELETE /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:19:47.413132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0aba09a7-6ed9-4772-b080-b9999c3d9fc4 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:47.413832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0aba09a7-6ed9-4772-b080-b9999c3d9fc4 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:47.421499 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0aba09a7-6ed9-4772-b080-b9999c3d9fc4 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:47.421958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0aba09a7-6ed9-4772-b080-b9999c3d9fc4 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.422716 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0aba09a7-6ed9-4772-b080-b9999c3d9fc4 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:47.423142 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0aba09a7-6ed9-4772-b080-b9999c3d9fc4 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.593270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0aba09a7-6ed9-4772-b080-b9999c3d9fc4 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:47.601735 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0aba09a7-6ed9-4772-b080-b9999c3d9fc4 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1505 microversion: 2.1 time: 0.194368 Jul 14 11:19:47.602319 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 488/972] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:47 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:48.623078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d160316-7bfa-4df0-a283-0a42ab4f5064 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:48.624367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d160316-7bfa-4df0-a283-0a42ab4f5064 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:48.633979 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d160316-7bfa-4df0-a283-0a42ab4f5064 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:48.634737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d160316-7bfa-4df0-a283-0a42ab4f5064 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:48.636161 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d160316-7bfa-4df0-a283-0a42ab4f5064 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:48.636923 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d160316-7bfa-4df0-a283-0a42ab4f5064 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:48.803129 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d160316-7bfa-4df0-a283-0a42ab4f5064 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:48.811939 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d160316-7bfa-4df0-a283-0a42ab4f5064 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1505 microversion: 2.1 time: 0.196693 Jul 14 11:19:48.812531 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 485/973] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:48 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:49.558699 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-ac4a49e4-fb83-4094-8d1d-2d109404066c req-39c39207-6548-499c-a798-5089d137b0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f029b310-6a6f-4a03-9f30-904c4197bfb9", "name": "network-vif-deleted", "tag": "c0c707e9-11f3-4820-bb25-dd5d2c4cdaca"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:49.569358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-ac4a49e4-fb83-4094-8d1d-2d109404066c req-39c39207-6548-499c-a798-5089d137b0ce service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.569800 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-ac4a49e4-fb83-4094-8d1d-2d109404066c req-39c39207-6548-499c-a798-5089d137b0ce service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.587687 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-ac4a49e4-fb83-4094-8d1d-2d109404066c req-39c39207-6548-499c-a798-5089d137b0ce service nova] Creating event network-vif-deleted:c0c707e9-11f3-4820-bb25-dd5d2c4cdaca for instance f029b310-6a6f-4a03-9f30-904c4197bfb9 on hv-cinder-84893 Jul 14 11:19:49.596331 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-ac4a49e4-fb83-4094-8d1d-2d109404066c req-39c39207-6548-499c-a798-5089d137b0ce service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042303 Jul 14 11:19:49.597004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 489/974] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:49.830898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a5738b6d-b1e4-457d-b3a9-1e90ea6b4691 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:49.831609 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a5738b6d-b1e4-457d-b3a9-1e90ea6b4691 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:49.838530 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5738b6d-b1e4-457d-b3a9-1e90ea6b4691 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.839026 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5738b6d-b1e4-457d-b3a9-1e90ea6b4691 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.839911 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5738b6d-b1e4-457d-b3a9-1e90ea6b4691 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.840400 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5738b6d-b1e4-457d-b3a9-1e90ea6b4691 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.907969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a5738b6d-b1e4-457d-b3a9-1e90ea6b4691 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:49.917965 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a5738b6d-b1e4-457d-b3a9-1e90ea6b4691 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1463 microversion: 2.1 time: 0.091393 Jul 14 11:19:49.918582 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 486/975] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:49 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:50.941848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0e8dc515-5096-4477-a0e8-a69d3345f3ca tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:50.942546 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0e8dc515-5096-4477-a0e8-a69d3345f3ca tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:50.952529 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e8dc515-5096-4477-a0e8-a69d3345f3ca tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:50.952978 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e8dc515-5096-4477-a0e8-a69d3345f3ca tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:50.953819 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e8dc515-5096-4477-a0e8-a69d3345f3ca tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:50.954263 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e8dc515-5096-4477-a0e8-a69d3345f3ca tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:51.022826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0e8dc515-5096-4477-a0e8-a69d3345f3ca tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:51.031946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0e8dc515-5096-4477-a0e8-a69d3345f3ca tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1299 microversion: 2.1 time: 0.094997 Jul 14 11:19:51.032613 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 490/976] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:50 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:52.051933 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cab0f618-0f01-48e9-8884-1b8c24a715fb tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:52.052667 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cab0f618-0f01-48e9-8884-1b8c24a715fb tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:52.060637 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cab0f618-0f01-48e9-8884-1b8c24a715fb tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:52.061171 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cab0f618-0f01-48e9-8884-1b8c24a715fb tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:52.062094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cab0f618-0f01-48e9-8884-1b8c24a715fb tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:52.062600 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cab0f618-0f01-48e9-8884-1b8c24a715fb tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:52.141054 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cab0f618-0f01-48e9-8884-1b8c24a715fb tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:52.149846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cab0f618-0f01-48e9-8884-1b8c24a715fb tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 200 len: 1299 microversion: 2.1 time: 0.103035 Jul 14 11:19:52.150457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 487/977] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:52 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:53.169249 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:53.169948 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: f029b310-6a6f-4a03-9f30-904c4197bfb9] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:53.178186 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:53.178744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:53.179698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:53.180192 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:53.197385 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] HTTP exception thrown: Instance f029b310-6a6f-4a03-9f30-904c4197bfb9 could not be found. Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Request method failure captured: Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 HTTP/1.1 Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_u1tHl4RdLgxDC3qK2xQuVnoYHWcGjErqAxnkmxnH0MetniwrY_M5fxfoMLFPK9jihUPBPFVhCPqmii8fUOo8W65YbqQtU7oh29Og3iYdmIbcoNgNMpL4Af4tL2P6yvz9r1Y44sA6cu2cnYITIOAmm2CxpxLsC3OxLT1OKscFzgtZA Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 442d027d621e40e2800fd6467f2bb60d Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesActionsTest-1996797270 Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:19:53.199414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/442d027d621e40e2800fd6467f2bb60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_442d027d621e40e2800fd6467f2bb60d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/442d027d621e40e2800fd6467f2bb60d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/442d027d621e40e2800fd6467f2bb60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesActionsTest-1996797270 Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 442d027d621e40e2800fd6467f2bb60d Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesActionsTest-1996797270 Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesActionsTest-1996797270-project Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 831f85e5678248b6b2991b8ac3a5e2b6 Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesActionsTest-1996797270-project Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance f029b310-6a6f-4a03-9f30-904c4197bfb9 could not be found. Jul 14 11:19:53.200806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'f029b310-6a6f-4a03-9f30-904c4197bfb9'} Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f029b310-6a6f-4a03-9f30-904c4197bfb9 could not be found. Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:19:53.201614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f029b310-6a6f-4a03-9f30-904c4197bfb9 could not be found. Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f029b310-6a6f-4a03-9f30-904c4197bfb9 could not be found. Jul 14 11:19:53.202975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:19:53.204358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Returning 404 to user: Instance f029b310-6a6f-4a03-9f30-904c4197bfb9 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:19:53.204358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-05705ad7-b584-429a-8ea3-ea772c784077 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9" status: 404 len: 111 microversion: 2.1 time: 0.035985 Jul 14 11:19:53.204358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 491/978] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:53 2022] GET /compute/v2.1/servers/f029b310-6a6f-4a03-9f30-904c4197bfb9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:19:53.321962 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1591584949", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "networks": [{"uuid": "57cccd21-e43b-4330-9949-ecb62e221d9b"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:53.383619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] validate_networks() for [('57cccd21-e43b-4330-9949-ecb62e221d9b', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:19:54.025101 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:19:54.025642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:19:54.026182 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:19:54.026654 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:19:54.027131 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:19:54.037620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:54.038178 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:54.039038 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:54.039584 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:54.058357 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Getting quotas for project 442d027d621e40e2800fd6467f2bb60d. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:54.063954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Getting quotas for user 831f85e5678248b6b2991b8ac3a5e2b6 and project 442d027d621e40e2800fd6467f2bb60d. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:54.078213 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:19:54.080573 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:19:54.132647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-df3b9c65-37f4-4d8c-875a-b06ce6aacbdc tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814441 Jul 14 11:19:54.133817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 488/979] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:19:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:19:54.150905 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c6aa4f6c-daa9-46e0-9be1-5e3cdba23858 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:54.152483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c6aa4f6c-daa9-46e0-9be1-5e3cdba23858 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:54.251990 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c6aa4f6c-daa9-46e0-9be1-5e3cdba23858 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:54.261346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c6aa4f6c-daa9-46e0-9be1-5e3cdba23858 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1214 microversion: 2.1 time: 0.117711 Jul 14 11:19:54.261927 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 492/980] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:54 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:54.972590 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-793ea061-1f54-4690-943d-2d1de5db7db7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:54.973415 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-793ea061-1f54-4690-943d-2d1de5db7db7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:54.981929 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-793ea061-1f54-4690-943d-2d1de5db7db7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:54.982616 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-793ea061-1f54-4690-943d-2d1de5db7db7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:54.983603 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-793ea061-1f54-4690-943d-2d1de5db7db7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:54.984137 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-793ea061-1f54-4690-943d-2d1de5db7db7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.156644 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-793ea061-1f54-4690-943d-2d1de5db7db7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:55.165533 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-793ea061-1f54-4690-943d-2d1de5db7db7 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1594 microversion: 2.1 time: 0.198960 Jul 14 11:19:55.166128 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 489/981] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:54 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1594 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:55.280736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3ea8f45b-e07e-48a0-9223-6cac6064873c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:55.281617 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3ea8f45b-e07e-48a0-9223-6cac6064873c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:55.284079 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:55.293050 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ea8f45b-e07e-48a0-9223-6cac6064873c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:55.293736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ea8f45b-e07e-48a0-9223-6cac6064873c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.294944 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ea8f45b-e07e-48a0-9223-6cac6064873c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:55.295722 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ea8f45b-e07e-48a0-9223-6cac6064873c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.421130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3ea8f45b-e07e-48a0-9223-6cac6064873c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:55.442360 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3ea8f45b-e07e-48a0-9223-6cac6064873c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1266 microversion: 2.1 time: 0.166861 Jul 14 11:19:55.443596 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 493/982] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:55 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:56.464535 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ffea856c-4f94-49c8-8703-e5240c2cd67f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:56.465802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ffea856c-4f94-49c8-8703-e5240c2cd67f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:56.477382 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffea856c-4f94-49c8-8703-e5240c2cd67f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:56.478045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffea856c-4f94-49c8-8703-e5240c2cd67f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:56.479170 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffea856c-4f94-49c8-8703-e5240c2cd67f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:56.479972 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffea856c-4f94-49c8-8703-e5240c2cd67f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:56.834719 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ffea856c-4f94-49c8-8703-e5240c2cd67f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:56.849305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ffea856c-4f94-49c8-8703-e5240c2cd67f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.390885 Jul 14 11:19:56.863481 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 490/983] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:56 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:57.668686 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-dc988bff-f0f9-4ca5-9ee9-0626cfccfab1 req-025347ca-4c64-40fe-90db-3cadbd255d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1f8709-c890-481d-952a-4d149b70b133", "tag": "1f5d2871-670f-4df5-94eb-b43ea68daf75"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:57.703242 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-dc988bff-f0f9-4ca5-9ee9-0626cfccfab1 req-025347ca-4c64-40fe-90db-3cadbd255d1f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.703921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-dc988bff-f0f9-4ca5-9ee9-0626cfccfab1 req-025347ca-4c64-40fe-90db-3cadbd255d1f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:57.728132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-dc988bff-f0f9-4ca5-9ee9-0626cfccfab1 req-025347ca-4c64-40fe-90db-3cadbd255d1f service nova] Creating event network-changed:1f5d2871-670f-4df5-94eb-b43ea68daf75 for instance 8d1f8709-c890-481d-952a-4d149b70b133 on hv-cinder-84893 Jul 14 11:19:57.735692 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-dc988bff-f0f9-4ca5-9ee9-0626cfccfab1 req-025347ca-4c64-40fe-90db-3cadbd255d1f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079471 Jul 14 11:19:57.736628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 494/984] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:57.877810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-74b4f8f9-5783-41a9-a37d-db22526007f7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:57.879314 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-74b4f8f9-5783-41a9-a37d-db22526007f7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:57.888629 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74b4f8f9-5783-41a9-a37d-db22526007f7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.889773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74b4f8f9-5783-41a9-a37d-db22526007f7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:57.891496 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74b4f8f9-5783-41a9-a37d-db22526007f7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.892591 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74b4f8f9-5783-41a9-a37d-db22526007f7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:57.932117 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:58.155695 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-74b4f8f9-5783-41a9-a37d-db22526007f7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:58.165846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-74b4f8f9-5783-41a9-a37d-db22526007f7 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.295400 Jul 14 11:19:58.167645 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 491/985] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:57 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:58.187253 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-b35a0d2a-1687-4859-93b5-c993bf9a9fc4 req-923d9601-e4ec-46ec-8545-4de9630c23f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6289419-08d9-4d3f-8178-fe2612830f3c", "tag": "eae020e3-68cc-41b2-b34f-a030ba6e139b"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:58.201049 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-b35a0d2a-1687-4859-93b5-c993bf9a9fc4 req-923d9601-e4ec-46ec-8545-4de9630c23f3 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:58.201504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-b35a0d2a-1687-4859-93b5-c993bf9a9fc4 req-923d9601-e4ec-46ec-8545-4de9630c23f3 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:58.216430 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-b35a0d2a-1687-4859-93b5-c993bf9a9fc4 req-923d9601-e4ec-46ec-8545-4de9630c23f3 service nova] Creating event network-changed:eae020e3-68cc-41b2-b34f-a030ba6e139b for instance f6289419-08d9-4d3f-8178-fe2612830f3c on hv-cinder-84893 Jul 14 11:19:58.222285 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-b35a0d2a-1687-4859-93b5-c993bf9a9fc4 req-923d9601-e4ec-46ec-8545-4de9630c23f3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294406 Jul 14 11:19:58.225701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 495/986] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:59.196045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5068be75-fd0c-4a83-bc44-11f22c974aab tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:59.196045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5068be75-fd0c-4a83-bc44-11f22c974aab tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:59.217956 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5068be75-fd0c-4a83-bc44-11f22c974aab tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.218920 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5068be75-fd0c-4a83-bc44-11f22c974aab tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.221416 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5068be75-fd0c-4a83-bc44-11f22c974aab tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.222384 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5068be75-fd0c-4a83-bc44-11f22c974aab tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.469455 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5068be75-fd0c-4a83-bc44-11f22c974aab tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:59.482270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5068be75-fd0c-4a83-bc44-11f22c974aab tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.297580 Jul 14 11:19:59.483377 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 492/987] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:59 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:59.806420 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-aafe09ac-962d-4702-8c06-b1d829b529f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1080523830"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:59.807052 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-aafe09ac-962d-4702-8c06-b1d829b529f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:59.813903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aafe09ac-962d-4702-8c06-b1d829b529f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.814396 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aafe09ac-962d-4702-8c06-b1d829b529f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.815178 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aafe09ac-962d-4702-8c06-b1d829b529f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.815642 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aafe09ac-962d-4702-8c06-b1d829b529f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.986491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.network.security_group_api [None req-aafe09ac-962d-4702-8c06-b1d829b529f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Adding security group 2a92649f-b339-48ec-bfeb-5c6c36e26fb6 to port eae020e3-68cc-41b2-b34f-a030ba6e139b Jul 14 11:20:00.428238 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-aafe09ac-962d-4702-8c06-b1d829b529f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "POST /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/action" status: 202 len: 0 microversion: 2.1 time: 0.626316 Jul 14 11:20:00.429061 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 496/988] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:19:59 2022] POST /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:20:00.451985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-7e1dbb90-6682-44cd-ae5f-6fc4dd4a2297 req-49036cb1-c490-4112-94f7-b773d3128e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6289419-08d9-4d3f-8178-fe2612830f3c", "tag": "eae020e3-68cc-41b2-b34f-a030ba6e139b"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:00.456755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7bb8f433-c710-4d40-8fa6-a821d3005f3d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:00.462785 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7bb8f433-c710-4d40-8fa6-a821d3005f3d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:00.482850 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bb8f433-c710-4d40-8fa6-a821d3005f3d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.483706 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bb8f433-c710-4d40-8fa6-a821d3005f3d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.485109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bb8f433-c710-4d40-8fa6-a821d3005f3d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.485870 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bb8f433-c710-4d40-8fa6-a821d3005f3d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.492653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-7e1dbb90-6682-44cd-ae5f-6fc4dd4a2297 req-49036cb1-c490-4112-94f7-b773d3128e8d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.493766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-7e1dbb90-6682-44cd-ae5f-6fc4dd4a2297 req-49036cb1-c490-4112-94f7-b773d3128e8d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.534040 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-7e1dbb90-6682-44cd-ae5f-6fc4dd4a2297 req-49036cb1-c490-4112-94f7-b773d3128e8d service nova] Creating event network-changed:eae020e3-68cc-41b2-b34f-a030ba6e139b for instance f6289419-08d9-4d3f-8178-fe2612830f3c on hv-cinder-84893 Jul 14 11:20:00.541974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-7e1dbb90-6682-44cd-ae5f-6fc4dd4a2297 req-49036cb1-c490-4112-94f7-b773d3128e8d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098301 Jul 14 11:20:00.546739 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 497/989] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:00.554205 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-09c60e89-1a4c-48af-83ec-1b1451306505 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:00.554914 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-09c60e89-1a4c-48af-83ec-1b1451306505 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:00.562157 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-09c60e89-1a4c-48af-83ec-1b1451306505 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.564101 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-09c60e89-1a4c-48af-83ec-1b1451306505 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.566437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-09c60e89-1a4c-48af-83ec-1b1451306505 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.567512 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-09c60e89-1a4c-48af-83ec-1b1451306505 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.816218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7bb8f433-c710-4d40-8fa6-a821d3005f3d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:00.838391 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-09c60e89-1a4c-48af-83ec-1b1451306505 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:00.844657 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7bb8f433-c710-4d40-8fa6-a821d3005f3d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1641 microversion: 2.1 time: 0.407536 Jul 14 11:20:00.846307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 493/990] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:00 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1641 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:00.848179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:00.858690 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-09c60e89-1a4c-48af-83ec-1b1451306505 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.309869 Jul 14 11:20:00.860524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 498/991] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:00 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:01.878682 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-de33444c-2492-4d89-9fe8-f2208a2d06a6 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:01.879555 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-de33444c-2492-4d89-9fe8-f2208a2d06a6 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:01.889209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de33444c-2492-4d89-9fe8-f2208a2d06a6 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:01.890469 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de33444c-2492-4d89-9fe8-f2208a2d06a6 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:01.891903 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de33444c-2492-4d89-9fe8-f2208a2d06a6 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:01.892678 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de33444c-2492-4d89-9fe8-f2208a2d06a6 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:02.106838 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de33444c-2492-4d89-9fe8-f2208a2d06a6 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:02.117161 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-de33444c-2492-4d89-9fe8-f2208a2d06a6 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.242766 Jul 14 11:20:02.118342 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 494/992] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:01 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:03.146403 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fded3085-da39-4067-ac76-61545bf11427 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:03.147504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fded3085-da39-4067-ac76-61545bf11427 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:03.160023 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fded3085-da39-4067-ac76-61545bf11427 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:03.160489 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fded3085-da39-4067-ac76-61545bf11427 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:03.161314 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fded3085-da39-4067-ac76-61545bf11427 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:03.161759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fded3085-da39-4067-ac76-61545bf11427 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:03.318351 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fded3085-da39-4067-ac76-61545bf11427 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:03.326721 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fded3085-da39-4067-ac76-61545bf11427 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.187600 Jul 14 11:20:03.327225 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 499/993] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:03 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:04.354191 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4995e115-1c80-4df4-8f0f-81bcf76ce1a3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:04.355243 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4995e115-1c80-4df4-8f0f-81bcf76ce1a3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:04.359114 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:04.360353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:04.371373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4995e115-1c80-4df4-8f0f-81bcf76ce1a3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:04.372325 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4995e115-1c80-4df4-8f0f-81bcf76ce1a3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:04.373642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4995e115-1c80-4df4-8f0f-81bcf76ce1a3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:04.374358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4995e115-1c80-4df4-8f0f-81bcf76ce1a3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:04.529686 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4995e115-1c80-4df4-8f0f-81bcf76ce1a3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:04.538022 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4995e115-1c80-4df4-8f0f-81bcf76ce1a3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.189625 Jul 14 11:20:04.538542 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 495/994] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:04 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:05.556125 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8671e5b3-5801-4cb5-b1fe-3eaabaf3a86e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:05.556763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8671e5b3-5801-4cb5-b1fe-3eaabaf3a86e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:05.559700 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:05.566129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8671e5b3-5801-4cb5-b1fe-3eaabaf3a86e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:05.566565 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8671e5b3-5801-4cb5-b1fe-3eaabaf3a86e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:05.567352 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8671e5b3-5801-4cb5-b1fe-3eaabaf3a86e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:05.567820 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8671e5b3-5801-4cb5-b1fe-3eaabaf3a86e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:05.732497 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8671e5b3-5801-4cb5-b1fe-3eaabaf3a86e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:05.740971 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8671e5b3-5801-4cb5-b1fe-3eaabaf3a86e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.188832 Jul 14 11:20:05.741563 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 500/995] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:05 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:05.772101 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-92df32e5-77de-4047-b387-3fe3d3d5449f req-169d479a-d817-4291-b14a-412e03b86f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1f8709-c890-481d-952a-4d149b70b133", "name": "network-vif-plugged", "status": "completed", "tag": "1f5d2871-670f-4df5-94eb-b43ea68daf75"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:05.788924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-92df32e5-77de-4047-b387-3fe3d3d5449f req-169d479a-d817-4291-b14a-412e03b86f3e service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:05.789754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-92df32e5-77de-4047-b387-3fe3d3d5449f req-169d479a-d817-4291-b14a-412e03b86f3e service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:05.813614 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-92df32e5-77de-4047-b387-3fe3d3d5449f req-169d479a-d817-4291-b14a-412e03b86f3e service nova] Creating event network-vif-plugged:1f5d2871-670f-4df5-94eb-b43ea68daf75 for instance 8d1f8709-c890-481d-952a-4d149b70b133 on hv-cinder-84893 Jul 14 11:20:05.823610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-92df32e5-77de-4047-b387-3fe3d3d5449f req-169d479a-d817-4291-b14a-412e03b86f3e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058300 Jul 14 11:20:05.824646 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 496/996] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:06.768797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-39991a48-ca5d-4679-b8dc-077953a4e31d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:06.769409 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-39991a48-ca5d-4679-b8dc-077953a4e31d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:06.776345 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39991a48-ca5d-4679-b8dc-077953a4e31d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:06.776795 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39991a48-ca5d-4679-b8dc-077953a4e31d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:06.777580 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39991a48-ca5d-4679-b8dc-077953a4e31d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:06.778011 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39991a48-ca5d-4679-b8dc-077953a4e31d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:06.931186 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-39991a48-ca5d-4679-b8dc-077953a4e31d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:06.940186 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-39991a48-ca5d-4679-b8dc-077953a4e31d tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.175875 Jul 14 11:20:06.940778 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 501/997] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:06 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:07.959315 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-09258dee-b284-43d3-a393-698e64522ec3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:07.960059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-09258dee-b284-43d3-a393-698e64522ec3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:07.966702 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09258dee-b284-43d3-a393-698e64522ec3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:07.967160 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09258dee-b284-43d3-a393-698e64522ec3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:07.967980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09258dee-b284-43d3-a393-698e64522ec3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:07.968415 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09258dee-b284-43d3-a393-698e64522ec3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:08.117911 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-09258dee-b284-43d3-a393-698e64522ec3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:08.128262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-09258dee-b284-43d3-a393-698e64522ec3 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1314 microversion: 2.1 time: 0.174298 Jul 14 11:20:08.128766 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 497/998] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:07 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:09.144956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1245b1a2-342c-40c0-8798-2aeacfa2b739 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:09.145605 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1245b1a2-342c-40c0-8798-2aeacfa2b739 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:09.152181 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1245b1a2-342c-40c0-8798-2aeacfa2b739 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:09.152634 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1245b1a2-342c-40c0-8798-2aeacfa2b739 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:09.153458 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1245b1a2-342c-40c0-8798-2aeacfa2b739 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:09.153917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1245b1a2-342c-40c0-8798-2aeacfa2b739 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:09.302848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1245b1a2-342c-40c0-8798-2aeacfa2b739 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:09.311927 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1245b1a2-342c-40c0-8798-2aeacfa2b739 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1498 microversion: 2.1 time: 0.170618 Jul 14 11:20:09.312434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 502/999] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:09 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:10.374746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-23c3b3a9-97db-48d1-b281-9036524a6e80 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:10.375366 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-23c3b3a9-97db-48d1-b281-9036524a6e80 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:10.383826 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23c3b3a9-97db-48d1-b281-9036524a6e80 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.384307 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23c3b3a9-97db-48d1-b281-9036524a6e80 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.385048 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23c3b3a9-97db-48d1-b281-9036524a6e80 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.385484 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23c3b3a9-97db-48d1-b281-9036524a6e80 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.412333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-23c3b3a9-97db-48d1-b281-9036524a6e80 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:20:10.496884 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-23c3b3a9-97db-48d1-b281-9036524a6e80 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 204 len: 0 microversion: 2.1 time: 0.124928 Jul 14 11:20:10.498068 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 498/1000] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:20:10 2022] DELETE /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:20:10.506986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3a2565f3-01fd-4484-8441-5230602ac40c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:10.507672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3a2565f3-01fd-4484-8441-5230602ac40c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:10.514553 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3a2565f3-01fd-4484-8441-5230602ac40c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.515001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3a2565f3-01fd-4484-8441-5230602ac40c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.515819 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3a2565f3-01fd-4484-8441-5230602ac40c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.516859 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3a2565f3-01fd-4484-8441-5230602ac40c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.665746 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3a2565f3-01fd-4484-8441-5230602ac40c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:10.680271 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3a2565f3-01fd-4484-8441-5230602ac40c tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1504 microversion: 2.1 time: 0.177223 Jul 14 11:20:10.681632 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 503/1001] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:10 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:11.707268 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-603948d0-12a5-4205-a359-35db9ff2c42e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:11.708074 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-603948d0-12a5-4205-a359-35db9ff2c42e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:11.714775 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-603948d0-12a5-4205-a359-35db9ff2c42e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:11.715361 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-603948d0-12a5-4205-a359-35db9ff2c42e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:11.716179 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-603948d0-12a5-4205-a359-35db9ff2c42e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:11.716609 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-603948d0-12a5-4205-a359-35db9ff2c42e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:11.881498 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-603948d0-12a5-4205-a359-35db9ff2c42e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:11.889465 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-603948d0-12a5-4205-a359-35db9ff2c42e tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1504 microversion: 2.1 time: 0.186511 Jul 14 11:20:11.890056 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 499/1002] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:11 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:12.907679 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d4c69827-21e7-431c-a1d2-598cfe8cb47f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:12.908611 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d4c69827-21e7-431c-a1d2-598cfe8cb47f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:12.916161 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4c69827-21e7-431c-a1d2-598cfe8cb47f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:12.916621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4c69827-21e7-431c-a1d2-598cfe8cb47f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:12.917732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4c69827-21e7-431c-a1d2-598cfe8cb47f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:12.918199 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4c69827-21e7-431c-a1d2-598cfe8cb47f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:13.060726 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d4c69827-21e7-431c-a1d2-598cfe8cb47f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831f85e5678248b6b2991b8ac3a5e2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442d027d621e40e2800fd6467f2bb60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:13.069473 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d4c69827-21e7-431c-a1d2-598cfe8cb47f tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 200 len: 1462 microversion: 2.1 time: 0.166087 Jul 14 11:20:13.070351 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 504/1003] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:12 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 1462 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:13.136468 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-eb972f4b-4fe7-408b-8cb2-f8a3baed5d88 req-e3ee257b-5463-41e2-adfc-81a6deeb2694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1f8709-c890-481d-952a-4d149b70b133", "name": "network-vif-deleted", "tag": "1f5d2871-670f-4df5-94eb-b43ea68daf75"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:13.149674 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-eb972f4b-4fe7-408b-8cb2-f8a3baed5d88 req-e3ee257b-5463-41e2-adfc-81a6deeb2694 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:13.150567 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-eb972f4b-4fe7-408b-8cb2-f8a3baed5d88 req-e3ee257b-5463-41e2-adfc-81a6deeb2694 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:13.164016 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-eb972f4b-4fe7-408b-8cb2-f8a3baed5d88 req-e3ee257b-5463-41e2-adfc-81a6deeb2694 service nova] Creating event network-vif-deleted:1f5d2871-670f-4df5-94eb-b43ea68daf75 for instance 8d1f8709-c890-481d-952a-4d149b70b133 on hv-cinder-84893 Jul 14 11:20:13.174816 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-eb972f4b-4fe7-408b-8cb2-f8a3baed5d88 req-e3ee257b-5463-41e2-adfc-81a6deeb2694 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041640 Jul 14 11:20:13.175783 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 500/1004] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:14.087340 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:14.088179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] [instance: 8d1f8709-c890-481d-952a-4d149b70b133] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:14.095182 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:14.095762 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:14.097189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:14.097636 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:14.111666 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] HTTP exception thrown: Instance 8d1f8709-c890-481d-952a-4d149b70b133 could not be found. Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Request method failure captured: Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 HTTP/1.1 Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_u1tHl4RdLgxDC3qK2xQuVnoYHWcGjErqAxnkmxnH0MetniwrY_M5fxfoMLFPK9jihUPBPFVhCPqmii8fUOo8W65YbqQtU7oh29Og3iYdmIbcoNgNMpL4Af4tL2P6yvz9r1Y44sA6cu2cnYITIOAmm2CxpxLsC3OxLT1OKscFzgtZA Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 442d027d621e40e2800fd6467f2bb60d Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesActionsTest-1996797270 Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:20:14.113910 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/442d027d621e40e2800fd6467f2bb60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_442d027d621e40e2800fd6467f2bb60d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/442d027d621e40e2800fd6467f2bb60d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/442d027d621e40e2800fd6467f2bb60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesActionsTest-1996797270 Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 442d027d621e40e2800fd6467f2bb60d Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesActionsTest-1996797270 Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesActionsTest-1996797270-project Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 831f85e5678248b6b2991b8ac3a5e2b6 Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesActionsTest-1996797270-project Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 8d1f8709-c890-481d-952a-4d149b70b133 could not be found. Jul 14 11:20:14.116516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '8d1f8709-c890-481d-952a-4d149b70b133'} Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d1f8709-c890-481d-952a-4d149b70b133 could not be found. Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:20:14.118004 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d1f8709-c890-481d-952a-4d149b70b133 could not be found. Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d1f8709-c890-481d-952a-4d149b70b133 could not be found. Jul 14 11:20:14.120676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:20:14.122913 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] Returning 404 to user: Instance 8d1f8709-c890-481d-952a-4d149b70b133 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:20:14.122913 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3fbfdbd2-4b8a-45f9-ad26-e2c8249f0326 tempest-VolumesActionsTest-1996797270 tempest-VolumesActionsTest-1996797270-project] 10.222.0.75 "GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133" status: 404 len: 111 microversion: 2.1 time: 0.033272 Jul 14 11:20:14.122913 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 505/1005] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:14 2022] GET /compute/v2.1/servers/8d1f8709-c890-481d-952a-4d149b70b133 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:20:35.885781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:35.887975 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:35.894366 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1077456420", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "networks": [{"uuid": "e084adea-c51c-44b5-8ae7-232bbfbba9fd"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:35.959946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] validate_networks() for [('e084adea-c51c-44b5-8ae7-232bbfbba9fd', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:20:36.490001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:20:36.490707 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:20:36.491425 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:20:36.493430 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:20:36.493863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:20:36.510420 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:36.511435 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:36.513597 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:36.515035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:36.555489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Getting quotas for project 183612235b834368be67c02434f45d36. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:20:36.563579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Getting quotas for user 6d9987a8042840caa38d2112fcce404a and project 183612235b834368be67c02434f45d36. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:20:36.592978 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:20:36.597819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:20:36.658622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab9b93b7-7874-4cad-8b28-cb5c38ef54af tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774648 Jul 14 11:20:36.667536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 501/1006] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:20:36.671015 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ef289d25-ed87-4d1e-820d-1fb819d780e1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:36.671923 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ef289d25-ed87-4d1e-820d-1fb819d780e1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:36.674217 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=41 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:36.675009 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=38 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:36.779575 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ef289d25-ed87-4d1e-820d-1fb819d780e1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:36.789248 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ef289d25-ed87-4d1e-820d-1fb819d780e1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1219 microversion: 2.1 time: 0.123071 Jul 14 11:20:36.800907 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 506/1007] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:36 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:37.808626 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f1969cc9-ee31-4fff-8809-b17e8fe2e4dd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:37.812059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f1969cc9-ee31-4fff-8809-b17e8fe2e4dd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:37.821072 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1969cc9-ee31-4fff-8809-b17e8fe2e4dd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.821577 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1969cc9-ee31-4fff-8809-b17e8fe2e4dd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.822505 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1969cc9-ee31-4fff-8809-b17e8fe2e4dd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.822941 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1969cc9-ee31-4fff-8809-b17e8fe2e4dd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.909518 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f1969cc9-ee31-4fff-8809-b17e8fe2e4dd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:37.917363 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f1969cc9-ee31-4fff-8809-b17e8fe2e4dd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1215 microversion: 2.1 time: 0.114352 Jul 14 11:20:37.919053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 502/1008] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:37 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:38.937502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e61d2d98-d58d-4ab7-8868-01face3c9836 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:38.938241 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e61d2d98-d58d-4ab7-8868-01face3c9836 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:38.946349 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e61d2d98-d58d-4ab7-8868-01face3c9836 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:38.946807 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e61d2d98-d58d-4ab7-8868-01face3c9836 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:38.947686 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e61d2d98-d58d-4ab7-8868-01face3c9836 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:38.948133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e61d2d98-d58d-4ab7-8868-01face3c9836 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:39.099725 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e61d2d98-d58d-4ab7-8868-01face3c9836 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:39.108028 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e61d2d98-d58d-4ab7-8868-01face3c9836 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1277 microversion: 2.1 time: 0.174560 Jul 14 11:20:39.108638 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 507/1009] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:38 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:40.130087 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3cea30e1-331d-487c-aa81-032dff0e7014 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:40.132688 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3cea30e1-331d-487c-aa81-032dff0e7014 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:40.153493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3cea30e1-331d-487c-aa81-032dff0e7014 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.153493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3cea30e1-331d-487c-aa81-032dff0e7014 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.153493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3cea30e1-331d-487c-aa81-032dff0e7014 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.153493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3cea30e1-331d-487c-aa81-032dff0e7014 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.307814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-22f8c8a5-b49a-4ced-b10b-5bb298ceaacd req-87a97047-104b-420a-b231-f1a5c4f87399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34185a2e-cf40-4a25-beca-13d498beee5e", "tag": "2b261c51-3385-4f44-9364-fcea5fd8b76e"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:40.320712 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-22f8c8a5-b49a-4ced-b10b-5bb298ceaacd req-87a97047-104b-420a-b231-f1a5c4f87399 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.327620 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-22f8c8a5-b49a-4ced-b10b-5bb298ceaacd req-87a97047-104b-420a-b231-f1a5c4f87399 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.341305 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-22f8c8a5-b49a-4ced-b10b-5bb298ceaacd req-87a97047-104b-420a-b231-f1a5c4f87399 service nova] Creating event network-changed:2b261c51-3385-4f44-9364-fcea5fd8b76e for instance 34185a2e-cf40-4a25-beca-13d498beee5e on hv-cinder-84893 Jul 14 11:20:40.350828 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-22f8c8a5-b49a-4ced-b10b-5bb298ceaacd req-87a97047-104b-420a-b231-f1a5c4f87399 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046897 Jul 14 11:20:40.351987 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 508/1010] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:20:40.365514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3cea30e1-331d-487c-aa81-032dff0e7014 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:40.374331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3cea30e1-331d-487c-aa81-032dff0e7014 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1319 microversion: 2.1 time: 0.251861 Jul 14 11:20:40.385358 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 503/1011] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:40 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:41.394597 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-39944d36-7013-4f2c-a153-67b405f9a223 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:41.395300 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-39944d36-7013-4f2c-a153-67b405f9a223 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:41.401634 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39944d36-7013-4f2c-a153-67b405f9a223 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:41.402084 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39944d36-7013-4f2c-a153-67b405f9a223 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:41.402850 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39944d36-7013-4f2c-a153-67b405f9a223 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:41.403287 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39944d36-7013-4f2c-a153-67b405f9a223 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:41.538732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-39944d36-7013-4f2c-a153-67b405f9a223 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:41.546203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-39944d36-7013-4f2c-a153-67b405f9a223 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1319 microversion: 2.1 time: 0.156586 Jul 14 11:20:41.546766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 509/1012] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:41 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:42.563672 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ff643f9b-f034-47c0-8236-a6323a6f6c79 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:42.564289 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ff643f9b-f034-47c0-8236-a6323a6f6c79 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:42.571840 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff643f9b-f034-47c0-8236-a6323a6f6c79 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:42.572297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff643f9b-f034-47c0-8236-a6323a6f6c79 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:42.573065 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff643f9b-f034-47c0-8236-a6323a6f6c79 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:42.573504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff643f9b-f034-47c0-8236-a6323a6f6c79 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:42.715218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ff643f9b-f034-47c0-8236-a6323a6f6c79 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:42.722727 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ff643f9b-f034-47c0-8236-a6323a6f6c79 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1319 microversion: 2.1 time: 0.163038 Jul 14 11:20:42.723285 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 504/1013] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:42 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:43.741877 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3c2ac83c-64ad-473d-a52c-6ad816ac7565 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:43.742630 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3c2ac83c-64ad-473d-a52c-6ad816ac7565 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:43.749638 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c2ac83c-64ad-473d-a52c-6ad816ac7565 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:43.750109 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c2ac83c-64ad-473d-a52c-6ad816ac7565 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:43.750912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c2ac83c-64ad-473d-a52c-6ad816ac7565 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:43.751356 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c2ac83c-64ad-473d-a52c-6ad816ac7565 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:43.900660 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3c2ac83c-64ad-473d-a52c-6ad816ac7565 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:43.908595 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3c2ac83c-64ad-473d-a52c-6ad816ac7565 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1319 microversion: 2.1 time: 0.172180 Jul 14 11:20:43.909266 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 510/1014] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:43 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:44.925228 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-48de664b-38f8-4b57-b2af-99699ea3ace2 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:44.925867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-48de664b-38f8-4b57-b2af-99699ea3ace2 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:44.932560 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48de664b-38f8-4b57-b2af-99699ea3ace2 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:44.933016 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48de664b-38f8-4b57-b2af-99699ea3ace2 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:44.933793 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48de664b-38f8-4b57-b2af-99699ea3ace2 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:44.934225 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48de664b-38f8-4b57-b2af-99699ea3ace2 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:45.097120 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-48de664b-38f8-4b57-b2af-99699ea3ace2 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:45.104818 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-48de664b-38f8-4b57-b2af-99699ea3ace2 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1319 microversion: 2.1 time: 0.183333 Jul 14 11:20:45.105402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 505/1015] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:44 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:45.276958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:20:45.277579 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:20:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:20:46.121701 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bc503aca-6226-4bd5-bdee-cf38a87a67ce tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:46.122312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bc503aca-6226-4bd5-bdee-cf38a87a67ce tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:46.132114 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc503aca-6226-4bd5-bdee-cf38a87a67ce tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:46.132570 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc503aca-6226-4bd5-bdee-cf38a87a67ce tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:46.133699 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc503aca-6226-4bd5-bdee-cf38a87a67ce tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:46.133979 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bc503aca-6226-4bd5-bdee-cf38a87a67ce tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:46.255459 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-0c816eb3-2381-49d2-b136-765bd199b455 req-52b6e108-8651-4823-8dc9-ab5d8dfc5232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34185a2e-cf40-4a25-beca-13d498beee5e", "name": "network-vif-plugged", "status": "completed", "tag": "2b261c51-3385-4f44-9364-fcea5fd8b76e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:46.266439 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-0c816eb3-2381-49d2-b136-765bd199b455 req-52b6e108-8651-4823-8dc9-ab5d8dfc5232 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:46.267209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-0c816eb3-2381-49d2-b136-765bd199b455 req-52b6e108-8651-4823-8dc9-ab5d8dfc5232 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:46.281901 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-0c816eb3-2381-49d2-b136-765bd199b455 req-52b6e108-8651-4823-8dc9-ab5d8dfc5232 service nova] Creating event network-vif-plugged:2b261c51-3385-4f44-9364-fcea5fd8b76e for instance 34185a2e-cf40-4a25-beca-13d498beee5e on hv-cinder-84893 Jul 14 11:20:46.287705 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-0c816eb3-2381-49d2-b136-765bd199b455 req-52b6e108-8651-4823-8dc9-ab5d8dfc5232 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036767 Jul 14 11:20:46.288729 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 506/1016] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:46.339149 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bc503aca-6226-4bd5-bdee-cf38a87a67ce tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:46.349338 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bc503aca-6226-4bd5-bdee-cf38a87a67ce tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1319 microversion: 2.1 time: 0.231256 Jul 14 11:20:46.350527 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 511/1017] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:46 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:47.365445 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:47.366221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:47.370773 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b6cfbce7-3cca-451b-b27e-d6e7df1ba464 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:47.371588 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b6cfbce7-3cca-451b-b27e-d6e7df1ba464 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:47.378618 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6cfbce7-3cca-451b-b27e-d6e7df1ba464 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.379057 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6cfbce7-3cca-451b-b27e-d6e7df1ba464 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.379848 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6cfbce7-3cca-451b-b27e-d6e7df1ba464 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.380285 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6cfbce7-3cca-451b-b27e-d6e7df1ba464 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.510613 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b6cfbce7-3cca-451b-b27e-d6e7df1ba464 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:47.519156 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b6cfbce7-3cca-451b-b27e-d6e7df1ba464 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1319 microversion: 2.1 time: 0.154563 Jul 14 11:20:47.519769 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 507/1018] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:47 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:48.540806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bacff5bf-004c-47e8-9946-7750e18598bd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:48.541452 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bacff5bf-004c-47e8-9946-7750e18598bd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:48.543677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:48.552320 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bacff5bf-004c-47e8-9946-7750e18598bd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:48.553040 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bacff5bf-004c-47e8-9946-7750e18598bd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:48.554356 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bacff5bf-004c-47e8-9946-7750e18598bd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:48.555113 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bacff5bf-004c-47e8-9946-7750e18598bd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:48.754846 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bacff5bf-004c-47e8-9946-7750e18598bd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:48.773294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bacff5bf-004c-47e8-9946-7750e18598bd tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1508 microversion: 2.1 time: 0.239424 Jul 14 11:20:48.774610 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 512/1019] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:48 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:06.700969 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:06.702369 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=34 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:06.951973 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bd12ca50-fa3e-4c2a-918e-d6ff45af9aa1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Action: 'create', calling method: .version_select at 0x7f579df440d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2122659772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6xUgzh8sf0zjOQu9E1P8k+Suw2EXFXDha7uRozQTQ2CbU17V+vA7ryYuGB1hkV8NHKh1f1xmsP1tMwpiLfDcQVKA68bLSOj959YX6sB/APPO7iM6BkBEUWom4iwgcBdA=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:06.968591 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-bd12ca50-fa3e-4c2a-918e-d6ff45af9aa1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Getting quotas for project 67f41dcdf6564bbd910a2285568941a1. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:21:06.973192 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-bd12ca50-fa3e-4c2a-918e-d6ff45af9aa1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Getting quotas for user d942201423da427b848dfd44b33358b8 and project 67f41dcdf6564bbd910a2285568941a1. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:21:07.018546 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bd12ca50-fa3e-4c2a-918e-d6ff45af9aa1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.322339 Jul 14 11:21:07.019125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 508/1020] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:21:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:21:12.137400 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d835571a-6460-4dfa-ab4f-3bd3ab00488d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1224396c-e0f4-485e-a57f-3d959ac4a794", "device": "/dev/sdb"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:12.141144 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d835571a-6460-4dfa-ab4f-3bd3ab00488d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:12.141394 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=16 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:12.142215 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=32 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:12.152026 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d835571a-6460-4dfa-ab4f-3bd3ab00488d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:12.152491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d835571a-6460-4dfa-ab4f-3bd3ab00488d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:12.153290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d835571a-6460-4dfa-ab4f-3bd3ab00488d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:12.153732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d835571a-6460-4dfa-ab4f-3bd3ab00488d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:12.438336 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d835571a-6460-4dfa-ab4f-3bd3ab00488d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "POST /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306320 Jul 14 11:21:12.439065 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 513/1021] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:21:12 2022] POST /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:21:26.573230 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:26.573947 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:26.578757 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-25618592-68d7-4aaf-8c0c-cc6b9a675771 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:26.579822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-25618592-68d7-4aaf-8c0c-cc6b9a675771 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:26.591550 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-25618592-68d7-4aaf-8c0c-cc6b9a675771 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:26.592020 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-25618592-68d7-4aaf-8c0c-cc6b9a675771 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:26.592834 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-25618592-68d7-4aaf-8c0c-cc6b9a675771 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:26.593277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-25618592-68d7-4aaf-8c0c-cc6b9a675771 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:26.673982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-25618592-68d7-4aaf-8c0c-cc6b9a675771 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "POST /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/action" status: 202 len: 0 microversion: 2.1 time: 0.102101 Jul 14 11:21:26.674617 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 509/1022] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:21:26 2022] POST /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:21:26.681355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:26.682166 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:26.687668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2b92a5e7-2702-42de-b4f9-22d55db3e821 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:26.688394 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2b92a5e7-2702-42de-b4f9-22d55db3e821 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:26.696828 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b92a5e7-2702-42de-b4f9-22d55db3e821 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:26.697427 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b92a5e7-2702-42de-b4f9-22d55db3e821 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:26.698174 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b92a5e7-2702-42de-b4f9-22d55db3e821 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:26.698697 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b92a5e7-2702-42de-b4f9-22d55db3e821 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:26.953752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2b92a5e7-2702-42de-b4f9-22d55db3e821 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:26.962645 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2b92a5e7-2702-42de-b4f9-22d55db3e821 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1752 microversion: 2.1 time: 0.282894 Jul 14 11:21:26.963334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 514/1023] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:26 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1752 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:27.981455 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-82557a5d-4d36-474d-8dc1-14861ac2d7b9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:27.982174 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-82557a5d-4d36-474d-8dc1-14861ac2d7b9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:27.988521 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82557a5d-4d36-474d-8dc1-14861ac2d7b9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:27.988964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82557a5d-4d36-474d-8dc1-14861ac2d7b9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:27.989730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82557a5d-4d36-474d-8dc1-14861ac2d7b9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:27.990158 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82557a5d-4d36-474d-8dc1-14861ac2d7b9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:28.146353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-82557a5d-4d36-474d-8dc1-14861ac2d7b9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:28.154580 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-82557a5d-4d36-474d-8dc1-14861ac2d7b9 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.177885 Jul 14 11:21:28.155153 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 510/1024] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:27 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:29.178133 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4e4c4dc0-1697-470b-aab3-a77e8361c98d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:29.179297 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4e4c4dc0-1697-470b-aab3-a77e8361c98d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:29.187983 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e4c4dc0-1697-470b-aab3-a77e8361c98d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:29.188422 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e4c4dc0-1697-470b-aab3-a77e8361c98d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:29.189185 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e4c4dc0-1697-470b-aab3-a77e8361c98d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:29.189621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e4c4dc0-1697-470b-aab3-a77e8361c98d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:29.368762 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4e4c4dc0-1697-470b-aab3-a77e8361c98d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:29.377082 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4e4c4dc0-1697-470b-aab3-a77e8361c98d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.207053 Jul 14 11:21:29.377658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 515/1025] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:29 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:30.394878 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e64bea2a-8178-4b39-951c-12b372bae3bc tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:30.395533 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e64bea2a-8178-4b39-951c-12b372bae3bc tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:30.406476 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e64bea2a-8178-4b39-951c-12b372bae3bc tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:30.406933 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e64bea2a-8178-4b39-951c-12b372bae3bc tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:30.407763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e64bea2a-8178-4b39-951c-12b372bae3bc tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:30.408310 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e64bea2a-8178-4b39-951c-12b372bae3bc tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:30.562552 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e64bea2a-8178-4b39-951c-12b372bae3bc tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:30.571527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e64bea2a-8178-4b39-951c-12b372bae3bc tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.180877 Jul 14 11:21:30.571993 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 511/1026] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:30 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:31.588752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ba5d61fc-34d1-4b24-8bb2-f8a09d7ccd82 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:31.589309 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ba5d61fc-34d1-4b24-8bb2-f8a09d7ccd82 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:31.596410 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba5d61fc-34d1-4b24-8bb2-f8a09d7ccd82 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:31.596853 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba5d61fc-34d1-4b24-8bb2-f8a09d7ccd82 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:31.597672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba5d61fc-34d1-4b24-8bb2-f8a09d7ccd82 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:31.598214 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba5d61fc-34d1-4b24-8bb2-f8a09d7ccd82 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:31.753033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ba5d61fc-34d1-4b24-8bb2-f8a09d7ccd82 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:31.761189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ba5d61fc-34d1-4b24-8bb2-f8a09d7ccd82 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.176330 Jul 14 11:21:31.761765 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 516/1027] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:31 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:32.778895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2c0944c8-1a23-4722-bbf2-1a1867a71ce0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:32.779613 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2c0944c8-1a23-4722-bbf2-1a1867a71ce0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:32.786195 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c0944c8-1a23-4722-bbf2-1a1867a71ce0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:32.786646 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c0944c8-1a23-4722-bbf2-1a1867a71ce0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:32.787448 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c0944c8-1a23-4722-bbf2-1a1867a71ce0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:32.787887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c0944c8-1a23-4722-bbf2-1a1867a71ce0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:32.937264 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2c0944c8-1a23-4722-bbf2-1a1867a71ce0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:32.945533 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2c0944c8-1a23-4722-bbf2-1a1867a71ce0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.170511 Jul 14 11:21:32.946104 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 512/1028] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:32 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:33.962134 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b589526d-f868-45ce-b52a-d5d49d49e109 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:33.962747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b589526d-f868-45ce-b52a-d5d49d49e109 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:33.969270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b589526d-f868-45ce-b52a-d5d49d49e109 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:33.969722 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b589526d-f868-45ce-b52a-d5d49d49e109 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:33.970486 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b589526d-f868-45ce-b52a-d5d49d49e109 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:33.971590 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b589526d-f868-45ce-b52a-d5d49d49e109 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:34.120087 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b589526d-f868-45ce-b52a-d5d49d49e109 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:34.128515 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b589526d-f868-45ce-b52a-d5d49d49e109 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.170266 Jul 14 11:21:34.129081 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 517/1029] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:33 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:35.145591 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e9a62a8f-7da3-49d8-b831-9fce17d931f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:35.146208 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e9a62a8f-7da3-49d8-b831-9fce17d931f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:35.152707 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9a62a8f-7da3-49d8-b831-9fce17d931f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:35.153156 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9a62a8f-7da3-49d8-b831-9fce17d931f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:35.153921 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9a62a8f-7da3-49d8-b831-9fce17d931f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:35.154363 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9a62a8f-7da3-49d8-b831-9fce17d931f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:35.297880 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e9a62a8f-7da3-49d8-b831-9fce17d931f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:35.306443 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e9a62a8f-7da3-49d8-b831-9fce17d931f1 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.164761 Jul 14 11:21:35.307006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 513/1030] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:35 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:36.323776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2f9141f4-6429-47ed-9443-2e38672df549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:36.324388 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2f9141f4-6429-47ed-9443-2e38672df549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:36.331337 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f9141f4-6429-47ed-9443-2e38672df549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:36.331890 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f9141f4-6429-47ed-9443-2e38672df549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:36.332647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f9141f4-6429-47ed-9443-2e38672df549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:36.333084 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f9141f4-6429-47ed-9443-2e38672df549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:36.479107 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2f9141f4-6429-47ed-9443-2e38672df549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:36.487526 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2f9141f4-6429-47ed-9443-2e38672df549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.167568 Jul 14 11:21:36.488099 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 518/1031] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:36 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:37.505270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6b5515a-091d-40ac-aca0-e5019742ab3c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:37.505800 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6b5515a-091d-40ac-aca0-e5019742ab3c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:37.513073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6b5515a-091d-40ac-aca0-e5019742ab3c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:37.513532 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6b5515a-091d-40ac-aca0-e5019742ab3c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:37.514302 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6b5515a-091d-40ac-aca0-e5019742ab3c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:37.514743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6b5515a-091d-40ac-aca0-e5019742ab3c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:37.665590 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6b5515a-091d-40ac-aca0-e5019742ab3c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:37.674723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6b5515a-091d-40ac-aca0-e5019742ab3c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.173506 Jul 14 11:21:37.675297 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 514/1032] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:37 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:38.692907 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a8c87904-c6bf-474d-9af3-31eaec9c1252 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:38.693506 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a8c87904-c6bf-474d-9af3-31eaec9c1252 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:38.700955 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a8c87904-c6bf-474d-9af3-31eaec9c1252 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:38.701398 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a8c87904-c6bf-474d-9af3-31eaec9c1252 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:38.702152 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a8c87904-c6bf-474d-9af3-31eaec9c1252 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:38.702584 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a8c87904-c6bf-474d-9af3-31eaec9c1252 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:38.846179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a8c87904-c6bf-474d-9af3-31eaec9c1252 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:38.854085 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a8c87904-c6bf-474d-9af3-31eaec9c1252 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.165892 Jul 14 11:21:38.854646 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 519/1033] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:38 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:39.872462 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b64d2fc4-4819-4683-879a-059b97dc4333 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:39.873027 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b64d2fc4-4819-4683-879a-059b97dc4333 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:39.880035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b64d2fc4-4819-4683-879a-059b97dc4333 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:39.880490 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b64d2fc4-4819-4683-879a-059b97dc4333 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:39.881248 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b64d2fc4-4819-4683-879a-059b97dc4333 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:39.881683 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b64d2fc4-4819-4683-879a-059b97dc4333 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:40.032239 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b64d2fc4-4819-4683-879a-059b97dc4333 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:40.041053 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b64d2fc4-4819-4683-879a-059b97dc4333 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.172551 Jul 14 11:21:40.041619 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 515/1034] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:39 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:41.058245 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-11151ba6-68fc-4abe-ac95-26e247fe1c27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:41.058836 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-11151ba6-68fc-4abe-ac95-26e247fe1c27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:41.065975 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11151ba6-68fc-4abe-ac95-26e247fe1c27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:41.066452 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11151ba6-68fc-4abe-ac95-26e247fe1c27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:41.067216 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11151ba6-68fc-4abe-ac95-26e247fe1c27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:41.067675 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11151ba6-68fc-4abe-ac95-26e247fe1c27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:41.223376 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-11151ba6-68fc-4abe-ac95-26e247fe1c27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:41.231448 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-11151ba6-68fc-4abe-ac95-26e247fe1c27 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.177408 Jul 14 11:21:41.232009 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 520/1035] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:41 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:42.249339 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e6de8650-2163-4ab0-84c3-4b7ef8b7782d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:42.250002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e6de8650-2163-4ab0-84c3-4b7ef8b7782d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:42.257227 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6de8650-2163-4ab0-84c3-4b7ef8b7782d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:42.257918 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6de8650-2163-4ab0-84c3-4b7ef8b7782d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:42.258689 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6de8650-2163-4ab0-84c3-4b7ef8b7782d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:42.259121 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6de8650-2163-4ab0-84c3-4b7ef8b7782d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:42.406447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6de8650-2163-4ab0-84c3-4b7ef8b7782d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:42.414809 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e6de8650-2163-4ab0-84c3-4b7ef8b7782d tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.169402 Jul 14 11:21:42.415418 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 516/1036] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:42 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:43.364255 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-de0e86c5-7d68-44b4-abac-33c185740d04 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:43.364801 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-de0e86c5-7d68-44b4-abac-33c185740d04 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:43.371285 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de0e86c5-7d68-44b4-abac-33c185740d04 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:43.371848 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de0e86c5-7d68-44b4-abac-33c185740d04 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:43.372618 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de0e86c5-7d68-44b4-abac-33c185740d04 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:43.373062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de0e86c5-7d68-44b4-abac-33c185740d04 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:43.433349 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3eb34a77-5674-4ce0-9295-ffbb27d588ca tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:43.433934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3eb34a77-5674-4ce0-9295-ffbb27d588ca tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:43.441780 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3eb34a77-5674-4ce0-9295-ffbb27d588ca tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:43.442270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3eb34a77-5674-4ce0-9295-ffbb27d588ca tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:43.443311 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3eb34a77-5674-4ce0-9295-ffbb27d588ca tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:43.443503 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3eb34a77-5674-4ce0-9295-ffbb27d588ca tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:43.458644 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-de0e86c5-7d68-44b4-abac-33c185740d04 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lazy-loading 'services' on Instance uuid 34185a2e-cf40-4a25-beca-13d498beee5e {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:21:43.541831 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-de0e86c5-7d68-44b4-abac-33c185740d04 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "DELETE /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e/os-volume_attachments/1224396c-e0f4-485e-a57f-3d959ac4a794" status: 202 len: 0 microversion: 2.1 time: 0.181562 Jul 14 11:21:43.542656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 521/1037] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:21:43 2022] DELETE /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e/os-volume_attachments/1224396c-e0f4-485e-a57f-3d959ac4a794 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:21:43.610467 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3eb34a77-5674-4ce0-9295-ffbb27d588ca tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:43.619308 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3eb34a77-5674-4ce0-9295-ffbb27d588ca tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.190128 Jul 14 11:21:43.619918 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 517/1038] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:43 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:43.949757 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1954346097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2122659772", "security_groups": [{"name": "tempest-secgroup-smoke-1504150156"}], "block_device_mapping_v2": [{"uuid": "4246e54e-4aeb-4808-ae5f-ea3bf651571a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba59ba1e-7990-4ba9-88ad-652628c8e3ee"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:44.064306 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] validate_networks() for [('ba59ba1e-7990-4ba9-88ad-652628c8e3ee', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:21:44.549318 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:21:44.549925 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:21:44.550890 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:21:44.551312 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:21:44.551775 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:21:44.561280 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:44.561732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:44.562542 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:44.562983 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:44.580614 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Getting quotas for project 67f41dcdf6564bbd910a2285568941a1. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:21:44.584584 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Getting quotas for user d942201423da427b848dfd44b33358b8 and project 67f41dcdf6564bbd910a2285568941a1. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:21:44.637170 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-df9ea413-a78f-4133-ba8e-b5ab133dbaad tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:44.637777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-df9ea413-a78f-4133-ba8e-b5ab133dbaad tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:44.644199 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:21:44.644604 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df9ea413-a78f-4133-ba8e-b5ab133dbaad tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:44.645058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df9ea413-a78f-4133-ba8e-b5ab133dbaad tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:44.645863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df9ea413-a78f-4133-ba8e-b5ab133dbaad tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:44.646300 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df9ea413-a78f-4133-ba8e-b5ab133dbaad tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:44.646789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4246e54e-4aeb-4808-ae5f-ea3bf651571a',volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:21:44.796512 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-df9ea413-a78f-4133-ba8e-b5ab133dbaad tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:44.805577 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-df9ea413-a78f-4133-ba8e-b5ab133dbaad tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1757 microversion: 2.1 time: 0.172173 Jul 14 11:21:44.806378 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 518/1039] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:44 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:44.828102 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-23868d8b-9d4f-4339-9139-78f9abaf5f10 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.882523 Jul 14 11:21:44.828758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 522/1040] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:21:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:21:44.839108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d8740736-a381-498b-9ea1-de2e37682616 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:44.839665 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d8740736-a381-498b-9ea1-de2e37682616 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:44.894417 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d8740736-a381-498b-9ea1-de2e37682616 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:44.901403 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d8740736-a381-498b-9ea1-de2e37682616 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1095 microversion: 2.1 time: 0.066199 Jul 14 11:21:44.901983 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 519/1041] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:44 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:45.749924 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2f9c2578-66a8-4bc0-974f-562de343edde tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:45.750572 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2f9c2578-66a8-4bc0-974f-562de343edde tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:45.757980 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f9c2578-66a8-4bc0-974f-562de343edde tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:45.758432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f9c2578-66a8-4bc0-974f-562de343edde tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:45.759209 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f9c2578-66a8-4bc0-974f-562de343edde tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:45.759674 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f9c2578-66a8-4bc0-974f-562de343edde tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:45.785747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2f9c2578-66a8-4bc0-974f-562de343edde tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:21:45.824399 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e4a9f721-3373-4031-8be3-440a374dc5b0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:45.825002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e4a9f721-3373-4031-8be3-440a374dc5b0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:45.833481 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e4a9f721-3373-4031-8be3-440a374dc5b0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:45.833937 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e4a9f721-3373-4031-8be3-440a374dc5b0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:45.834953 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e4a9f721-3373-4031-8be3-440a374dc5b0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:45.835606 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e4a9f721-3373-4031-8be3-440a374dc5b0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:45.886584 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2f9c2578-66a8-4bc0-974f-562de343edde tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "DELETE /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 204 len: 0 microversion: 2.1 time: 0.140044 Jul 14 11:21:45.887524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 523/1042] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:21:45 2022] DELETE /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:21:45.898660 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-43a27cc8-363a-4118-9ea5-2b11a708d3cb tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:45.899403 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-43a27cc8-363a-4118-9ea5-2b11a708d3cb tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:45.907218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43a27cc8-363a-4118-9ea5-2b11a708d3cb tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:45.907744 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43a27cc8-363a-4118-9ea5-2b11a708d3cb tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:45.908596 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43a27cc8-363a-4118-9ea5-2b11a708d3cb tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:45.909036 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43a27cc8-363a-4118-9ea5-2b11a708d3cb tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:46.009083 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e4a9f721-3373-4031-8be3-440a374dc5b0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:46.017950 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e4a9f721-3373-4031-8be3-440a374dc5b0 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1760 microversion: 2.1 time: 0.197373 Jul 14 11:21:46.019024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 520/1043] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:45 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:46.024538 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-acc126e4-5950-449e-848b-2debaff3f03b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:46.025178 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-acc126e4-5950-449e-848b-2debaff3f03b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:46.031236 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-acc126e4-5950-449e-848b-2debaff3f03b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:46.031723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-acc126e4-5950-449e-848b-2debaff3f03b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:46.032502 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-acc126e4-5950-449e-848b-2debaff3f03b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:46.032943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-acc126e4-5950-449e-848b-2debaff3f03b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:46.054933 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-43a27cc8-363a-4118-9ea5-2b11a708d3cb tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:46.063246 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-43a27cc8-363a-4118-9ea5-2b11a708d3cb tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1514 microversion: 2.1 time: 0.170871 Jul 14 11:21:46.063879 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 524/1044] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:45 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:46.095280 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-acc126e4-5950-449e-848b-2debaff3f03b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:46.103504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-acc126e4-5950-449e-848b-2debaff3f03b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1201 microversion: 2.1 time: 0.082573 Jul 14 11:21:46.104066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 521/1045] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:46 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1201 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:47.080637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bb2f9419-d2e9-48ce-8663-7745a5a59180 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:47.081179 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bb2f9419-d2e9-48ce-8663-7745a5a59180 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:47.087865 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bb2f9419-d2e9-48ce-8663-7745a5a59180 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:47.088323 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bb2f9419-d2e9-48ce-8663-7745a5a59180 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:47.089094 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bb2f9419-d2e9-48ce-8663-7745a5a59180 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:47.089531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bb2f9419-d2e9-48ce-8663-7745a5a59180 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:47.120561 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-963238d8-48e8-4d14-924e-236f606a27d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:47.121175 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-963238d8-48e8-4d14-924e-236f606a27d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:47.127584 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-963238d8-48e8-4d14-924e-236f606a27d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:47.128034 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-963238d8-48e8-4d14-924e-236f606a27d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:47.128795 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-963238d8-48e8-4d14-924e-236f606a27d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:47.129258 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-963238d8-48e8-4d14-924e-236f606a27d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:47.194059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-963238d8-48e8-4d14-924e-236f606a27d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:47.201933 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-963238d8-48e8-4d14-924e-236f606a27d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1201 microversion: 2.1 time: 0.085077 Jul 14 11:21:47.202588 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 522/1046] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:47 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:47.228637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bb2f9419-d2e9-48ce-8663-7745a5a59180 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:47.236087 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bb2f9419-d2e9-48ce-8663-7745a5a59180 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1514 microversion: 2.1 time: 0.159433 Jul 14 11:21:47.236648 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 525/1047] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:47 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:48.218767 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eefed781-bf66-49e8-92dd-104441154916 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:48.220400 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eefed781-bf66-49e8-92dd-104441154916 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:48.228718 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eefed781-bf66-49e8-92dd-104441154916 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:48.229558 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eefed781-bf66-49e8-92dd-104441154916 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:48.230758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eefed781-bf66-49e8-92dd-104441154916 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:48.231562 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eefed781-bf66-49e8-92dd-104441154916 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:48.257654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-79ce689b-da9f-41f1-99e8-57a644b3065c tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:48.261534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-79ce689b-da9f-41f1-99e8-57a644b3065c tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:48.271062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79ce689b-da9f-41f1-99e8-57a644b3065c tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:48.271831 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79ce689b-da9f-41f1-99e8-57a644b3065c tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:48.273173 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79ce689b-da9f-41f1-99e8-57a644b3065c tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:48.273788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79ce689b-da9f-41f1-99e8-57a644b3065c tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:48.401489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eefed781-bf66-49e8-92dd-104441154916 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:48.409447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eefed781-bf66-49e8-92dd-104441154916 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1279 microversion: 2.1 time: 0.195068 Jul 14 11:21:48.410332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 523/1048] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:48 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:48.575861 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-79ce689b-da9f-41f1-99e8-57a644b3065c tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:48.583643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-79ce689b-da9f-41f1-99e8-57a644b3065c tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 200 len: 1514 microversion: 2.1 time: 0.333502 Jul 14 11:21:48.584231 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 526/1049] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:48 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 1514 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:48.956223 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a153517e-7777-460c-acea-6883baa51156 req-40f77f77-bfb3-42fc-988c-68cf1217ba9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34185a2e-cf40-4a25-beca-13d498beee5e", "name": "network-vif-deleted", "tag": "2b261c51-3385-4f44-9364-fcea5fd8b76e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:48.970478 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a153517e-7777-460c-acea-6883baa51156 req-40f77f77-bfb3-42fc-988c-68cf1217ba9b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:48.971006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a153517e-7777-460c-acea-6883baa51156 req-40f77f77-bfb3-42fc-988c-68cf1217ba9b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:48.984406 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a153517e-7777-460c-acea-6883baa51156 req-40f77f77-bfb3-42fc-988c-68cf1217ba9b service nova] Creating event network-vif-deleted:2b261c51-3385-4f44-9364-fcea5fd8b76e for instance 34185a2e-cf40-4a25-beca-13d498beee5e on hv-cinder-84893 Jul 14 11:21:48.990706 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a153517e-7777-460c-acea-6883baa51156 req-40f77f77-bfb3-42fc-988c-68cf1217ba9b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038055 Jul 14 11:21:48.991610 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 524/1050] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:21:49.426984 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3638b97b-af7f-48cf-9f7c-79b5fda9f455 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:49.427628 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3638b97b-af7f-48cf-9f7c-79b5fda9f455 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:49.434381 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3638b97b-af7f-48cf-9f7c-79b5fda9f455 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:49.434831 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3638b97b-af7f-48cf-9f7c-79b5fda9f455 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:49.436447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3638b97b-af7f-48cf-9f7c-79b5fda9f455 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:49.436928 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3638b97b-af7f-48cf-9f7c-79b5fda9f455 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:49.602144 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:49.602841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 34185a2e-cf40-4a25-beca-13d498beee5e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:49.609107 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:49.609553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:49.610313 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:49.610746 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:49.624157 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] HTTP exception thrown: Instance 34185a2e-cf40-4a25-beca-13d498beee5e could not be found. Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Request method failure captured: Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e HTTP/1.1 Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_wCgb7N4YzpFX_H9WjymlZHeoV2rcTahHP12570jeQBpry7m6jhKpAehStgWoHyQW_DovhsvA4hbk4BaXu2m-FxBqCquzetvLrrm5IZhENRj1WX5PeQqcEurixXrMdkxsFXS0kl-LWdOZf2pNdzkjW3_MjXfU9j2xOiKBGdBVmQB4o Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 183612235b834368be67c02434f45d36 Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotTestJSON-345252182 Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:21:49.625828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/183612235b834368be67c02434f45d36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_183612235b834368be67c02434f45d36", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/183612235b834368be67c02434f45d36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/183612235b834368be67c02434f45d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotTestJSON-345252182 Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 183612235b834368be67c02434f45d36 Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-345252182 Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotTestJSON-345252182-project Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 6d9987a8042840caa38d2112fcce404a Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotTestJSON-345252182-project Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance 34185a2e-cf40-4a25-beca-13d498beee5e could not be found. Jul 14 11:21:49.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '34185a2e-cf40-4a25-beca-13d498beee5e'} Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34185a2e-cf40-4a25-beca-13d498beee5e could not be found. Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:21:49.628457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34185a2e-cf40-4a25-beca-13d498beee5e could not be found. Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34185a2e-cf40-4a25-beca-13d498beee5e could not be found. Jul 14 11:21:49.630410 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:21:49.632308 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Returning 404 to user: Instance 34185a2e-cf40-4a25-beca-13d498beee5e could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:21:49.632308 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3c1a3ae9-fd82-47c2-8b03-36cf3635970a tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e" status: 404 len: 111 microversion: 2.1 time: 0.030362 Jul 14 11:21:49.632308 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 525/1051] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:49 2022] GET /compute/v2.1/servers/34185a2e-cf40-4a25-beca-13d498beee5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:21:49.668911 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3638b97b-af7f-48cf-9f7c-79b5fda9f455 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:49.677376 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3638b97b-af7f-48cf-9f7c-79b5fda9f455 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.254835 Jul 14 11:21:49.687771 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 527/1052] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:49 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:50.695414 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-563c2fc0-270a-4ee7-baad-37acd52a4df9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:50.696066 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-563c2fc0-270a-4ee7-baad-37acd52a4df9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:50.702569 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-563c2fc0-270a-4ee7-baad-37acd52a4df9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:50.703049 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-563c2fc0-270a-4ee7-baad-37acd52a4df9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:50.703850 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-563c2fc0-270a-4ee7-baad-37acd52a4df9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:50.704291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-563c2fc0-270a-4ee7-baad-37acd52a4df9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:50.836133 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-563c2fc0-270a-4ee7-baad-37acd52a4df9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:50.839605 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:50.844570 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-563c2fc0-270a-4ee7-baad-37acd52a4df9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.153190 Jul 14 11:21:50.845127 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 526/1053] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:50 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:51.005288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-6b5a7b8b-485e-4f5f-9d5c-1d968115517a req-667da6cb-eb5f-41ce-baeb-d3c9f72f8c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e09bb3-a737-40f6-b960-8d581524e93a", "tag": "c42476bd-315b-4076-a2d2-9a430b4c7ec7"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:51.013776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-6b5a7b8b-485e-4f5f-9d5c-1d968115517a req-667da6cb-eb5f-41ce-baeb-d3c9f72f8c16 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:51.014211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-6b5a7b8b-485e-4f5f-9d5c-1d968115517a req-667da6cb-eb5f-41ce-baeb-d3c9f72f8c16 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:51.026000 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-6b5a7b8b-485e-4f5f-9d5c-1d968115517a req-667da6cb-eb5f-41ce-baeb-d3c9f72f8c16 service nova] Creating event network-changed:c42476bd-315b-4076-a2d2-9a430b4c7ec7 for instance a7e09bb3-a737-40f6-b960-8d581524e93a on hv-cinder-84893 Jul 14 11:21:51.030917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-6b5a7b8b-485e-4f5f-9d5c-1d968115517a req-667da6cb-eb5f-41ce-baeb-d3c9f72f8c16 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029783 Jul 14 11:21:51.031532 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 528/1054] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:21:51.861099 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab4d0c09-2185-47de-8f1e-23e33ecf31cb tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:51.861709 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab4d0c09-2185-47de-8f1e-23e33ecf31cb tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:51.870291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c09-2185-47de-8f1e-23e33ecf31cb tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:51.870753 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c09-2185-47de-8f1e-23e33ecf31cb tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:51.871559 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c09-2185-47de-8f1e-23e33ecf31cb tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:51.871999 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab4d0c09-2185-47de-8f1e-23e33ecf31cb tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:52.002765 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab4d0c09-2185-47de-8f1e-23e33ecf31cb tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:52.011042 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab4d0c09-2185-47de-8f1e-23e33ecf31cb tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.153587 Jul 14 11:21:52.011697 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 527/1055] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:51 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:53.034165 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-87740406-f33c-490d-a12b-72600212ec43 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:53.034857 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-87740406-f33c-490d-a12b-72600212ec43 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:53.041615 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-87740406-f33c-490d-a12b-72600212ec43 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:53.042068 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-87740406-f33c-490d-a12b-72600212ec43 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:53.042824 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-87740406-f33c-490d-a12b-72600212ec43 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:53.043259 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-87740406-f33c-490d-a12b-72600212ec43 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:53.061890 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:53.175582 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-87740406-f33c-490d-a12b-72600212ec43 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:53.183884 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-87740406-f33c-490d-a12b-72600212ec43 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.154414 Jul 14 11:21:53.184468 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 529/1056] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:53 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:54.200752 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fdc93563-e804-48fc-a629-b7020e183d92 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:54.201365 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fdc93563-e804-48fc-a629-b7020e183d92 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:54.208514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdc93563-e804-48fc-a629-b7020e183d92 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:54.208957 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdc93563-e804-48fc-a629-b7020e183d92 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:54.209904 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdc93563-e804-48fc-a629-b7020e183d92 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:54.210339 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdc93563-e804-48fc-a629-b7020e183d92 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:54.350819 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fdc93563-e804-48fc-a629-b7020e183d92 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:54.358391 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fdc93563-e804-48fc-a629-b7020e183d92 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.161609 Jul 14 11:21:54.358956 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 528/1057] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:54 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:55.375235 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a594324b-8e9f-4978-9028-d0ef9d70241d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:55.375881 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a594324b-8e9f-4978-9028-d0ef9d70241d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:55.378226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:55.378945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:55.384698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a594324b-8e9f-4978-9028-d0ef9d70241d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:55.385141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a594324b-8e9f-4978-9028-d0ef9d70241d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:55.385892 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a594324b-8e9f-4978-9028-d0ef9d70241d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:55.386321 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a594324b-8e9f-4978-9028-d0ef9d70241d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:55.522046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a594324b-8e9f-4978-9028-d0ef9d70241d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:55.529589 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a594324b-8e9f-4978-9028-d0ef9d70241d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.158842 Jul 14 11:21:55.530159 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 530/1058] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:55 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:56.546253 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f4cca0b-e1db-49aa-9abc-76b55848b458 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:56.546889 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f4cca0b-e1db-49aa-9abc-76b55848b458 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:56.548666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:56.555272 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f4cca0b-e1db-49aa-9abc-76b55848b458 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:56.555757 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f4cca0b-e1db-49aa-9abc-76b55848b458 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:56.556552 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f4cca0b-e1db-49aa-9abc-76b55848b458 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:56.556990 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f4cca0b-e1db-49aa-9abc-76b55848b458 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:56.688431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0f4cca0b-e1db-49aa-9abc-76b55848b458 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:56.696489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f4cca0b-e1db-49aa-9abc-76b55848b458 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.154243 Jul 14 11:21:56.697062 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 529/1059] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:56 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:57.713371 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6e2e0deb-c365-48b4-a180-3c9dad3037f9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:57.713989 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6e2e0deb-c365-48b4-a180-3c9dad3037f9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:57.716350 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:57.721626 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e2e0deb-c365-48b4-a180-3c9dad3037f9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:57.722072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e2e0deb-c365-48b4-a180-3c9dad3037f9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:57.723353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e2e0deb-c365-48b4-a180-3c9dad3037f9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:57.723815 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e2e0deb-c365-48b4-a180-3c9dad3037f9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:57.859560 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6e2e0deb-c365-48b4-a180-3c9dad3037f9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:57.868071 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6e2e0deb-c365-48b4-a180-3c9dad3037f9 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.158563 Jul 14 11:21:57.868637 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 531/1060] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:57 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:58.886056 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a19a7282-f626-476b-b0ae-9d1dcf3c62dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:58.886775 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a19a7282-f626-476b-b0ae-9d1dcf3c62dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:58.889581 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=45 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:58.896586 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a19a7282-f626-476b-b0ae-9d1dcf3c62dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:58.897035 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a19a7282-f626-476b-b0ae-9d1dcf3c62dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:58.898019 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a19a7282-f626-476b-b0ae-9d1dcf3c62dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:58.898650 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a19a7282-f626-476b-b0ae-9d1dcf3c62dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:59.036366 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a19a7282-f626-476b-b0ae-9d1dcf3c62dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:59.043863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a19a7282-f626-476b-b0ae-9d1dcf3c62dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.162375 Jul 14 11:21:59.044458 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 530/1061] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:58 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:00.061950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bf21dbed-8a32-4cbb-82e7-5541a69e55b4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:00.062504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bf21dbed-8a32-4cbb-82e7-5541a69e55b4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:00.069014 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf21dbed-8a32-4cbb-82e7-5541a69e55b4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:00.069470 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf21dbed-8a32-4cbb-82e7-5541a69e55b4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:00.070233 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf21dbed-8a32-4cbb-82e7-5541a69e55b4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:00.070673 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bf21dbed-8a32-4cbb-82e7-5541a69e55b4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:00.203218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bf21dbed-8a32-4cbb-82e7-5541a69e55b4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:00.211432 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bf21dbed-8a32-4cbb-82e7-5541a69e55b4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.153717 Jul 14 11:22:00.212002 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 532/1062] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:00 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:00.541982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-825018563", "imageRef": "c3452b9e-0f50-4bd5-963d-b021114dbaa0", "flavorRef": "452", "networks": [{"uuid": "e084adea-c51c-44b5-8ae7-232bbfbba9fd"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:00.596551 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] validate_networks() for [('e084adea-c51c-44b5-8ae7-232bbfbba9fd', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:22:00.951435 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:22:00.951854 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:22:00.952319 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:22:00.952768 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:22:00.953125 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:22:00.962497 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:00.962934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:00.963755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:00.964179 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:00.981558 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Getting quotas for project 183612235b834368be67c02434f45d36. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:22:00.985514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Getting quotas for user 6d9987a8042840caa38d2112fcce404a and project 183612235b834368be67c02434f45d36. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:22:00.996553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:22:00.998841 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3452b9e-0f50-4bd5-963d-b021114dbaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:22:01.045665 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ef74cb86-a069-49cb-9e68-0a99fa2b7f80 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507475 Jul 14 11:22:01.046310 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 531/1063] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:22:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:22:01.056203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fbef23f5-b2d3-4b7a-b11b-738de01b05c1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:01.056812 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fbef23f5-b2d3-4b7a-b11b-738de01b05c1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:01.112758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fbef23f5-b2d3-4b7a-b11b-738de01b05c1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:01.120264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fbef23f5-b2d3-4b7a-b11b-738de01b05c1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1218 microversion: 2.1 time: 0.067870 Jul 14 11:22:01.120826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 533/1064] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:01 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:22:01.227714 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4f52c55f-97ec-468a-bc48-008cbe549f14 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:01.228331 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4f52c55f-97ec-468a-bc48-008cbe549f14 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:01.234636 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f52c55f-97ec-468a-bc48-008cbe549f14 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:01.235101 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f52c55f-97ec-468a-bc48-008cbe549f14 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:01.235894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f52c55f-97ec-468a-bc48-008cbe549f14 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:01.236329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f52c55f-97ec-468a-bc48-008cbe549f14 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:01.377424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4f52c55f-97ec-468a-bc48-008cbe549f14 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:01.385336 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4f52c55f-97ec-468a-bc48-008cbe549f14 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.161744 Jul 14 11:22:01.387618 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 532/1065] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:01 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:02.137971 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3dd83dd0-b594-40a0-9c23-791b35e7369e tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:02.139220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3dd83dd0-b594-40a0-9c23-791b35e7369e tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:02.147335 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3dd83dd0-b594-40a0-9c23-791b35e7369e tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:02.147839 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3dd83dd0-b594-40a0-9c23-791b35e7369e tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:02.148816 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3dd83dd0-b594-40a0-9c23-791b35e7369e tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:02.149431 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3dd83dd0-b594-40a0-9c23-791b35e7369e tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:02.230710 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3dd83dd0-b594-40a0-9c23-791b35e7369e tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:02.240209 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3dd83dd0-b594-40a0-9c23-791b35e7369e tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1288 microversion: 2.1 time: 0.105963 Jul 14 11:22:02.240934 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 534/1066] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:02 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:02.402789 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9944a19a-66b2-46f0-97b4-716188953d8a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:02.403418 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9944a19a-66b2-46f0-97b4-716188953d8a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:02.410163 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9944a19a-66b2-46f0-97b4-716188953d8a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:02.410614 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9944a19a-66b2-46f0-97b4-716188953d8a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:02.412081 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9944a19a-66b2-46f0-97b4-716188953d8a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:02.412522 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9944a19a-66b2-46f0-97b4-716188953d8a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:02.549758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9944a19a-66b2-46f0-97b4-716188953d8a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:02.558038 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9944a19a-66b2-46f0-97b4-716188953d8a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.159130 Jul 14 11:22:02.558615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 533/1067] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:02 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:03.258050 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4d02020c-2e22-484b-b190-fc03cd2528e6 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:03.258787 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4d02020c-2e22-484b-b190-fc03cd2528e6 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:03.265364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d02020c-2e22-484b-b190-fc03cd2528e6 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:03.265811 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d02020c-2e22-484b-b190-fc03cd2528e6 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:03.266579 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d02020c-2e22-484b-b190-fc03cd2528e6 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:03.267010 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d02020c-2e22-484b-b190-fc03cd2528e6 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:03.463902 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4d02020c-2e22-484b-b190-fc03cd2528e6 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:03.471521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4d02020c-2e22-484b-b190-fc03cd2528e6 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1318 microversion: 2.1 time: 0.217387 Jul 14 11:22:03.481081 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 535/1068] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:03 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:03.577777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3600c16c-f79d-488e-8582-e5a15b8fda0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:03.578402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3600c16c-f79d-488e-8582-e5a15b8fda0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:03.586318 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3600c16c-f79d-488e-8582-e5a15b8fda0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:03.587104 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3600c16c-f79d-488e-8582-e5a15b8fda0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:03.588369 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3600c16c-f79d-488e-8582-e5a15b8fda0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:03.594649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-b1f139a6-f72f-4d92-9931-237d33fdea90 req-68636177-72d1-4dc5-9013-dd0aebfa5201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420743bb-6eb8-44bc-8880-4ce1311d900e", "tag": "65ccab1d-a1e5-4af7-9e35-c9a73a1dd15d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:03.601688 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3600c16c-f79d-488e-8582-e5a15b8fda0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:03.612651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-b1f139a6-f72f-4d92-9931-237d33fdea90 req-68636177-72d1-4dc5-9013-dd0aebfa5201 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:03.613346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-b1f139a6-f72f-4d92-9931-237d33fdea90 req-68636177-72d1-4dc5-9013-dd0aebfa5201 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:03.639201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-b1f139a6-f72f-4d92-9931-237d33fdea90 req-68636177-72d1-4dc5-9013-dd0aebfa5201 service nova] Creating event network-changed:65ccab1d-a1e5-4af7-9e35-c9a73a1dd15d for instance 420743bb-6eb8-44bc-8880-4ce1311d900e on hv-cinder-84893 Jul 14 11:22:03.648940 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-b1f139a6-f72f-4d92-9931-237d33fdea90 req-68636177-72d1-4dc5-9013-dd0aebfa5201 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058753 Jul 14 11:22:03.651140 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 536/1069] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:22:03.660434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-18bc30af-f67b-4b4b-afe7-49c35ac8bb9d req-c3b33cb2-ec9d-45c7-873d-ae26dd90f33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e09bb3-a737-40f6-b960-8d581524e93a", "name": "network-vif-plugged", "status": "completed", "tag": "c42476bd-315b-4076-a2d2-9a430b4c7ec7"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:03.674531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-18bc30af-f67b-4b4b-afe7-49c35ac8bb9d req-c3b33cb2-ec9d-45c7-873d-ae26dd90f33d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:03.675507 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-18bc30af-f67b-4b4b-afe7-49c35ac8bb9d req-c3b33cb2-ec9d-45c7-873d-ae26dd90f33d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:03.688866 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-18bc30af-f67b-4b4b-afe7-49c35ac8bb9d req-c3b33cb2-ec9d-45c7-873d-ae26dd90f33d service nova] Creating event network-vif-plugged:c42476bd-315b-4076-a2d2-9a430b4c7ec7 for instance a7e09bb3-a737-40f6-b960-8d581524e93a on hv-cinder-84893 Jul 14 11:22:03.694337 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-18bc30af-f67b-4b4b-afe7-49c35ac8bb9d req-c3b33cb2-ec9d-45c7-873d-ae26dd90f33d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040616 Jul 14 11:22:03.694943 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 537/1070] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:22:03.771596 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3600c16c-f79d-488e-8582-e5a15b8fda0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:03.779248 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3600c16c-f79d-488e-8582-e5a15b8fda0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.207684 Jul 14 11:22:03.779858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 534/1071] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:03 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:04.490041 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-349e3d61-3291-47bc-bd03-b943b8d9c71b tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:04.490839 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-349e3d61-3291-47bc-bd03-b943b8d9c71b tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:04.497363 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-349e3d61-3291-47bc-bd03-b943b8d9c71b tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:04.497806 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-349e3d61-3291-47bc-bd03-b943b8d9c71b tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:04.498577 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-349e3d61-3291-47bc-bd03-b943b8d9c71b tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:04.499002 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-349e3d61-3291-47bc-bd03-b943b8d9c71b tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:04.634293 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-349e3d61-3291-47bc-bd03-b943b8d9c71b tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:04.641694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-349e3d61-3291-47bc-bd03-b943b8d9c71b tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1318 microversion: 2.1 time: 0.156376 Jul 14 11:22:04.642252 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 538/1072] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:04 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:04.796859 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8d782da7-803f-498b-b7fb-c1b7a5f7cd2a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:04.797430 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8d782da7-803f-498b-b7fb-c1b7a5f7cd2a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:04.803899 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8d782da7-803f-498b-b7fb-c1b7a5f7cd2a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:04.804345 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8d782da7-803f-498b-b7fb-c1b7a5f7cd2a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:04.805108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8d782da7-803f-498b-b7fb-c1b7a5f7cd2a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:04.805540 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8d782da7-803f-498b-b7fb-c1b7a5f7cd2a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:04.936124 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8d782da7-803f-498b-b7fb-c1b7a5f7cd2a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:04.944153 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8d782da7-803f-498b-b7fb-c1b7a5f7cd2a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.151340 Jul 14 11:22:04.944729 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 535/1073] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:04 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:05.658078 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e8ecb0e3-8a01-4243-8497-4a7da6e0d47f tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:05.658720 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e8ecb0e3-8a01-4243-8497-4a7da6e0d47f tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:05.665766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e8ecb0e3-8a01-4243-8497-4a7da6e0d47f tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:05.666219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e8ecb0e3-8a01-4243-8497-4a7da6e0d47f tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:05.666983 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e8ecb0e3-8a01-4243-8497-4a7da6e0d47f tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:05.667447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e8ecb0e3-8a01-4243-8497-4a7da6e0d47f tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:05.803833 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e8ecb0e3-8a01-4243-8497-4a7da6e0d47f tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:05.811633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e8ecb0e3-8a01-4243-8497-4a7da6e0d47f tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1318 microversion: 2.1 time: 0.157389 Jul 14 11:22:05.812207 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 539/1074] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:05 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:05.961323 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13c97847-09df-46e7-b3b2-7d238ac1bb18 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:05.961861 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-13c97847-09df-46e7-b3b2-7d238ac1bb18 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:05.968343 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13c97847-09df-46e7-b3b2-7d238ac1bb18 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:05.968799 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13c97847-09df-46e7-b3b2-7d238ac1bb18 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:05.969562 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13c97847-09df-46e7-b3b2-7d238ac1bb18 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:05.969998 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13c97847-09df-46e7-b3b2-7d238ac1bb18 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:06.104267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-13c97847-09df-46e7-b3b2-7d238ac1bb18 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:06.111674 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-13c97847-09df-46e7-b3b2-7d238ac1bb18 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.154815 Jul 14 11:22:06.112247 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 536/1075] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:05 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:06.828277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-96430a54-97e5-4073-b360-640de60ad0b0 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:06.828882 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-96430a54-97e5-4073-b360-640de60ad0b0 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:06.836008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96430a54-97e5-4073-b360-640de60ad0b0 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:06.836453 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96430a54-97e5-4073-b360-640de60ad0b0 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:06.837236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96430a54-97e5-4073-b360-640de60ad0b0 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:06.837656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-96430a54-97e5-4073-b360-640de60ad0b0 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:06.966400 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-96430a54-97e5-4073-b360-640de60ad0b0 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:06.974249 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-96430a54-97e5-4073-b360-640de60ad0b0 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1318 microversion: 2.1 time: 0.150244 Jul 14 11:22:06.974811 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 540/1076] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:06 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:07.129120 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-05d039a4-5aa1-4577-a704-344e85e87ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:07.130175 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-05d039a4-5aa1-4577-a704-344e85e87ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:07.136570 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05d039a4-5aa1-4577-a704-344e85e87ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:07.137013 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05d039a4-5aa1-4577-a704-344e85e87ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:07.137763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05d039a4-5aa1-4577-a704-344e85e87ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:07.138189 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05d039a4-5aa1-4577-a704-344e85e87ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:07.270880 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-05d039a4-5aa1-4577-a704-344e85e87ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:07.278690 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-05d039a4-5aa1-4577-a704-344e85e87ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1267 microversion: 2.1 time: 0.153549 Jul 14 11:22:07.279260 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 537/1077] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:07 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:07.991940 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d26894f9-9baf-44ba-b51b-dc0223fe6cfa tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:07.992496 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d26894f9-9baf-44ba-b51b-dc0223fe6cfa tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:07.998943 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d26894f9-9baf-44ba-b51b-dc0223fe6cfa tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:07.999408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d26894f9-9baf-44ba-b51b-dc0223fe6cfa tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:08.000193 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d26894f9-9baf-44ba-b51b-dc0223fe6cfa tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:08.000631 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d26894f9-9baf-44ba-b51b-dc0223fe6cfa tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:08.132611 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d26894f9-9baf-44ba-b51b-dc0223fe6cfa tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:08.140678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d26894f9-9baf-44ba-b51b-dc0223fe6cfa tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1318 microversion: 2.1 time: 0.153308 Jul 14 11:22:08.141250 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 541/1078] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:07 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:08.296184 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e15e919-426f-41d2-bd64-3baa476ea16e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:08.296846 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e15e919-426f-41d2-bd64-3baa476ea16e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:08.304045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e15e919-426f-41d2-bd64-3baa476ea16e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:08.304503 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e15e919-426f-41d2-bd64-3baa476ea16e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:08.305285 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e15e919-426f-41d2-bd64-3baa476ea16e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:08.305730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e15e919-426f-41d2-bd64-3baa476ea16e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:08.439867 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e15e919-426f-41d2-bd64-3baa476ea16e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:08.447329 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e15e919-426f-41d2-bd64-3baa476ea16e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1454 microversion: 2.1 time: 0.155114 Jul 14 11:22:08.447924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 538/1079] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:08 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:08.463678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-62fec0fd-df9d-459d-b9f5-b81ba25f3770 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:08.464288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-62fec0fd-df9d-459d-b9f5-b81ba25f3770 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:08.470223 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-62fec0fd-df9d-459d-b9f5-b81ba25f3770 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:08.470676 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-62fec0fd-df9d-459d-b9f5-b81ba25f3770 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:08.471479 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-62fec0fd-df9d-459d-b9f5-b81ba25f3770 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:08.471925 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-62fec0fd-df9d-459d-b9f5-b81ba25f3770 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:08.601833 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-62fec0fd-df9d-459d-b9f5-b81ba25f3770 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:08.609308 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-62fec0fd-df9d-459d-b9f5-b81ba25f3770 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1454 microversion: 2.1 time: 0.150033 Jul 14 11:22:08.609870 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 542/1080] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:08 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:09.158110 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3f0bc33a-3329-4681-ba77-3bf50faac3ef tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:09.158719 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3f0bc33a-3329-4681-ba77-3bf50faac3ef tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:09.165330 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f0bc33a-3329-4681-ba77-3bf50faac3ef tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:09.165779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f0bc33a-3329-4681-ba77-3bf50faac3ef tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:09.166552 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f0bc33a-3329-4681-ba77-3bf50faac3ef tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:09.166982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f0bc33a-3329-4681-ba77-3bf50faac3ef tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:09.300138 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3f0bc33a-3329-4681-ba77-3bf50faac3ef tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:09.308982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3f0bc33a-3329-4681-ba77-3bf50faac3ef tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1318 microversion: 2.1 time: 0.154723 Jul 14 11:22:09.309550 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 539/1081] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:09 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:09.652834 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-5c91b0ec-c7ba-4864-9fd3-77635a043735 req-631cd343-945f-4bd2-8e56-60a0c6ad6116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420743bb-6eb8-44bc-8880-4ce1311d900e", "name": "network-vif-plugged", "status": "completed", "tag": "65ccab1d-a1e5-4af7-9e35-c9a73a1dd15d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:09.661570 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5c91b0ec-c7ba-4864-9fd3-77635a043735 req-631cd343-945f-4bd2-8e56-60a0c6ad6116 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:09.662022 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5c91b0ec-c7ba-4864-9fd3-77635a043735 req-631cd343-945f-4bd2-8e56-60a0c6ad6116 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:09.674454 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-5c91b0ec-c7ba-4864-9fd3-77635a043735 req-631cd343-945f-4bd2-8e56-60a0c6ad6116 service nova] Creating event network-vif-plugged:65ccab1d-a1e5-4af7-9e35-c9a73a1dd15d for instance 420743bb-6eb8-44bc-8880-4ce1311d900e on hv-cinder-84893 Jul 14 11:22:09.680958 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-5c91b0ec-c7ba-4864-9fd3-77635a043735 req-631cd343-945f-4bd2-8e56-60a0c6ad6116 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032400 Jul 14 11:22:09.682288 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 543/1082] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:22:10.325116 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-12f0679a-707d-4a11-a8e6-effdf0855949 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:10.325730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-12f0679a-707d-4a11-a8e6-effdf0855949 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:10.332476 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12f0679a-707d-4a11-a8e6-effdf0855949 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:10.333002 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12f0679a-707d-4a11-a8e6-effdf0855949 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:10.333779 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12f0679a-707d-4a11-a8e6-effdf0855949 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:10.334214 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12f0679a-707d-4a11-a8e6-effdf0855949 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:10.358350 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-5acd358d-fadb-4f59-a2f3-22185ac218f4 req-5d06fd8b-fa06-4e67-b1f5-c2b2b2d4a11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e09bb3-a737-40f6-b960-8d581524e93a", "tag": "c42476bd-315b-4076-a2d2-9a430b4c7ec7"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:10.367789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5acd358d-fadb-4f59-a2f3-22185ac218f4 req-5d06fd8b-fa06-4e67-b1f5-c2b2b2d4a11d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:10.368578 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5acd358d-fadb-4f59-a2f3-22185ac218f4 req-5d06fd8b-fa06-4e67-b1f5-c2b2b2d4a11d service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:10.380903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-5acd358d-fadb-4f59-a2f3-22185ac218f4 req-5d06fd8b-fa06-4e67-b1f5-c2b2b2d4a11d service nova] Creating event network-changed:c42476bd-315b-4076-a2d2-9a430b4c7ec7 for instance a7e09bb3-a737-40f6-b960-8d581524e93a on hv-cinder-84893 Jul 14 11:22:10.386245 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-5acd358d-fadb-4f59-a2f3-22185ac218f4 req-5d06fd8b-fa06-4e67-b1f5-c2b2b2d4a11d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031721 Jul 14 11:22:10.387300 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 544/1083] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:22:10.469638 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-12f0679a-707d-4a11-a8e6-effdf0855949 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:10.478342 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-12f0679a-707d-4a11-a8e6-effdf0855949 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1318 microversion: 2.1 time: 0.157051 Jul 14 11:22:10.479006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 540/1084] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:10 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:11.493982 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:11.498902 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e12b827f-bb6c-42f2-9b6d-45c3fe618922 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:11.499719 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e12b827f-bb6c-42f2-9b6d-45c3fe618922 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:11.507294 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e12b827f-bb6c-42f2-9b6d-45c3fe618922 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:11.507811 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e12b827f-bb6c-42f2-9b6d-45c3fe618922 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:11.508595 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e12b827f-bb6c-42f2-9b6d-45c3fe618922 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:11.509031 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e12b827f-bb6c-42f2-9b6d-45c3fe618922 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:11.791475 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e12b827f-bb6c-42f2-9b6d-45c3fe618922 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:11.798864 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e12b827f-bb6c-42f2-9b6d-45c3fe618922 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1318 microversion: 2.1 time: 0.306350 Jul 14 11:22:11.799451 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 545/1085] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:11 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:12.816316 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-11de76bd-4c30-473b-aff7-67c2515b2c78 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:12.816923 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-11de76bd-4c30-473b-aff7-67c2515b2c78 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:12.818782 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:12.819473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:12.825785 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11de76bd-4c30-473b-aff7-67c2515b2c78 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:12.826233 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11de76bd-4c30-473b-aff7-67c2515b2c78 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:12.827008 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11de76bd-4c30-473b-aff7-67c2515b2c78 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:12.827474 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11de76bd-4c30-473b-aff7-67c2515b2c78 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:12.961600 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-11de76bd-4c30-473b-aff7-67c2515b2c78 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:12.968968 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-11de76bd-4c30-473b-aff7-67c2515b2c78 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1507 microversion: 2.1 time: 0.156570 Jul 14 11:22:12.969538 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 541/1086] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:12 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:12.985444 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7488db6e-fc0b-4ba7-ad53-43201a67e766 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60810759-1338-49b4-8025-2bc7eaa0aec4", "device": "/dev/sdb"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:12.986536 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7488db6e-fc0b-4ba7-ad53-43201a67e766 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:12.993144 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7488db6e-fc0b-4ba7-ad53-43201a67e766 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:12.993600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7488db6e-fc0b-4ba7-ad53-43201a67e766 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:12.994362 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7488db6e-fc0b-4ba7-ad53-43201a67e766 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:12.994802 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7488db6e-fc0b-4ba7-ad53-43201a67e766 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:13.249299 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7488db6e-fc0b-4ba7-ad53-43201a67e766 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "POST /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267631 Jul 14 11:22:13.249920 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 546/1087] 10.222.0.75 () {60 vars in 1322 bytes} [Thu Jul 14 11:22:12 2022] POST /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:22:35.609649 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5cb16f1e-e29b-47bf-b3a7-7e0a58f505a8 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:35.610159 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5cb16f1e-e29b-47bf-b3a7-7e0a58f505a8 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:35.612257 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:35.613024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=86 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:35.619539 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5cb16f1e-e29b-47bf-b3a7-7e0a58f505a8 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:35.619994 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5cb16f1e-e29b-47bf-b3a7-7e0a58f505a8 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:35.620771 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5cb16f1e-e29b-47bf-b3a7-7e0a58f505a8 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:35.621217 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5cb16f1e-e29b-47bf-b3a7-7e0a58f505a8 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:35.700879 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-5cb16f1e-e29b-47bf-b3a7-7e0a58f505a8 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lazy-loading 'services' on Instance uuid 420743bb-6eb8-44bc-8880-4ce1311d900e {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:22:35.776172 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5cb16f1e-e29b-47bf-b3a7-7e0a58f505a8 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "DELETE /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e/os-volume_attachments/60810759-1338-49b4-8025-2bc7eaa0aec4" status: 202 len: 0 microversion: 2.1 time: 0.170179 Jul 14 11:22:35.776713 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 542/1088] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:22:35 2022] DELETE /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e/os-volume_attachments/60810759-1338-49b4-8025-2bc7eaa0aec4 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:22:36.898800 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0ad74d5a-a38b-42c9-90f4-a6652b010b4d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:36.899329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0ad74d5a-a38b-42c9-90f4-a6652b010b4d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:36.903804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=33 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:36.904827 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:36.910106 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ad74d5a-a38b-42c9-90f4-a6652b010b4d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:36.910555 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ad74d5a-a38b-42c9-90f4-a6652b010b4d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:36.911341 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ad74d5a-a38b-42c9-90f4-a6652b010b4d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:36.911798 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ad74d5a-a38b-42c9-90f4-a6652b010b4d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:36.941921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0ad74d5a-a38b-42c9-90f4-a6652b010b4d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:22:37.025270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0ad74d5a-a38b-42c9-90f4-a6652b010b4d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "DELETE /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 204 len: 0 microversion: 2.1 time: 0.130863 Jul 14 11:22:37.026041 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 547/1089] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:22:36 2022] DELETE /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:22:37.036488 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-090e7ec0-3c30-47ad-9eb7-b15b2eaa72d1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:37.037755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-090e7ec0-3c30-47ad-9eb7-b15b2eaa72d1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:37.044388 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-090e7ec0-3c30-47ad-9eb7-b15b2eaa72d1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:37.044839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-090e7ec0-3c30-47ad-9eb7-b15b2eaa72d1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:37.045608 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-090e7ec0-3c30-47ad-9eb7-b15b2eaa72d1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:37.046045 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-090e7ec0-3c30-47ad-9eb7-b15b2eaa72d1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:37.177156 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-090e7ec0-3c30-47ad-9eb7-b15b2eaa72d1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:37.185116 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-090e7ec0-3c30-47ad-9eb7-b15b2eaa72d1 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1513 microversion: 2.1 time: 0.154071 Jul 14 11:22:37.185689 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 543/1090] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:37 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:22:38.202665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0fd86e2f-d249-483a-9420-b8074c7b775d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:38.203406 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0fd86e2f-d249-483a-9420-b8074c7b775d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:38.209898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0fd86e2f-d249-483a-9420-b8074c7b775d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:38.210351 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0fd86e2f-d249-483a-9420-b8074c7b775d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:38.211145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0fd86e2f-d249-483a-9420-b8074c7b775d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:38.211619 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0fd86e2f-d249-483a-9420-b8074c7b775d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:38.390008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0fd86e2f-d249-483a-9420-b8074c7b775d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:38.398048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0fd86e2f-d249-483a-9420-b8074c7b775d tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1513 microversion: 2.1 time: 0.199645 Jul 14 11:22:38.398609 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 548/1091] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:38 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:39.415795 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-48753c28-5e8e-40ba-89aa-9ed601b5de03 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:39.416504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-48753c28-5e8e-40ba-89aa-9ed601b5de03 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:39.423548 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48753c28-5e8e-40ba-89aa-9ed601b5de03 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:39.424000 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48753c28-5e8e-40ba-89aa-9ed601b5de03 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:39.424781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48753c28-5e8e-40ba-89aa-9ed601b5de03 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:39.425220 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48753c28-5e8e-40ba-89aa-9ed601b5de03 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:39.500358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-c4436fb1-fb2c-42d9-aea8-8e1e6213147e req-ed766624-7c51-4f86-bd64-080eceeb27b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420743bb-6eb8-44bc-8880-4ce1311d900e", "name": "network-vif-deleted", "tag": "65ccab1d-a1e5-4af7-9e35-c9a73a1dd15d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:39.510788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-c4436fb1-fb2c-42d9-aea8-8e1e6213147e req-ed766624-7c51-4f86-bd64-080eceeb27b8 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:39.511762 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-c4436fb1-fb2c-42d9-aea8-8e1e6213147e req-ed766624-7c51-4f86-bd64-080eceeb27b8 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:39.524333 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-c4436fb1-fb2c-42d9-aea8-8e1e6213147e req-ed766624-7c51-4f86-bd64-080eceeb27b8 service nova] Creating event network-vif-deleted:65ccab1d-a1e5-4af7-9e35-c9a73a1dd15d for instance 420743bb-6eb8-44bc-8880-4ce1311d900e on hv-cinder-84893 Jul 14 11:22:39.532420 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-c4436fb1-fb2c-42d9-aea8-8e1e6213147e req-ed766624-7c51-4f86-bd64-080eceeb27b8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035554 Jul 14 11:22:39.533722 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 549/1092] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:22:39.579052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-48753c28-5e8e-40ba-89aa-9ed601b5de03 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9987a8042840caa38d2112fcce404a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183612235b834368be67c02434f45d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:39.588196 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-48753c28-5e8e-40ba-89aa-9ed601b5de03 tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 200 len: 1471 microversion: 2.1 time: 0.176817 Jul 14 11:22:39.588882 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 544/1093] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:39 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:40.605814 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:40.606510 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] [instance: 420743bb-6eb8-44bc-8880-4ce1311d900e] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:40.612781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:40.613237 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:40.613992 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:40.614425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:40.627545 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] HTTP exception thrown: Instance 420743bb-6eb8-44bc-8880-4ce1311d900e could not be found. Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Request method failure captured: Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e HTTP/1.1 Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_wCgb7N4YzpFX_H9WjymlZHeoV2rcTahHP12570jeQBpry7m6jhKpAehStgWoHyQW_DovhsvA4hbk4BaXu2m-FxBqCquzetvLrrm5IZhENRj1WX5PeQqcEurixXrMdkxsFXS0kl-LWdOZf2pNdzkjW3_MjXfU9j2xOiKBGdBVmQB4o Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 183612235b834368be67c02434f45d36 Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesSnapshotTestJSON-345252182 Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:22:40.629132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/183612235b834368be67c02434f45d36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_183612235b834368be67c02434f45d36", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/183612235b834368be67c02434f45d36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/183612235b834368be67c02434f45d36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesSnapshotTestJSON-345252182 Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 183612235b834368be67c02434f45d36 Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-345252182 Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesSnapshotTestJSON-345252182-project Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: 6d9987a8042840caa38d2112fcce404a Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesSnapshotTestJSON-345252182-project Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 420743bb-6eb8-44bc-8880-4ce1311d900e could not be found. Jul 14 11:22:40.630761 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '420743bb-6eb8-44bc-8880-4ce1311d900e'} Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420743bb-6eb8-44bc-8880-4ce1311d900e could not be found. Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:22:40.632498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420743bb-6eb8-44bc-8880-4ce1311d900e could not be found. Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420743bb-6eb8-44bc-8880-4ce1311d900e could not be found. Jul 14 11:22:40.634016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.635163 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] Returning 404 to user: Instance 420743bb-6eb8-44bc-8880-4ce1311d900e could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:22:40.635163 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-32fbae8f-3c13-4277-81f0-470ad60c49ab tempest-VolumesSnapshotTestJSON-345252182 tempest-VolumesSnapshotTestJSON-345252182-project] 10.222.0.75 "GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e" status: 404 len: 111 microversion: 2.1 time: 0.029712 Jul 14 11:22:40.635163 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 550/1094] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:40 2022] GET /compute/v2.1/servers/420743bb-6eb8-44bc-8880-4ce1311d900e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:23:09.658868 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-84ea0084-cbad-4032-ada5-63ebaacb267b tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1080523830"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:09.659556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-84ea0084-cbad-4032-ada5-63ebaacb267b tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:09.661858 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:09.662531 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:09.668550 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84ea0084-cbad-4032-ada5-63ebaacb267b tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.669004 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84ea0084-cbad-4032-ada5-63ebaacb267b tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.669788 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84ea0084-cbad-4032-ada5-63ebaacb267b tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.670227 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84ea0084-cbad-4032-ada5-63ebaacb267b tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.803479 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.network.security_group_api [None req-84ea0084-cbad-4032-ada5-63ebaacb267b tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Removing security group 2a92649f-b339-48ec-bfeb-5c6c36e26fb6 from port eae020e3-68cc-41b2-b34f-a030ba6e139b Jul 14 11:23:10.181875 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-84ea0084-cbad-4032-ada5-63ebaacb267b tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "POST /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/action" status: 202 len: 0 microversion: 2.1 time: 0.526384 Jul 14 11:23:10.182487 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 545/1095] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:23:09 2022] POST /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:23:10.207039 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-5bc0c0de-7aaa-4396-8a5c-691ee9d3e0a8 req-45c1a7e9-e882-4ee0-a95d-299f45c1aa10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6289419-08d9-4d3f-8178-fe2612830f3c", "tag": "eae020e3-68cc-41b2-b34f-a030ba6e139b"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:10.220574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:10.221574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:10.234625 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5bc0c0de-7aaa-4396-8a5c-691ee9d3e0a8 req-45c1a7e9-e882-4ee0-a95d-299f45c1aa10 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.235545 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5bc0c0de-7aaa-4396-8a5c-691ee9d3e0a8 req-45c1a7e9-e882-4ee0-a95d-299f45c1aa10 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.249857 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-5bc0c0de-7aaa-4396-8a5c-691ee9d3e0a8 req-45c1a7e9-e882-4ee0-a95d-299f45c1aa10 service nova] Creating event network-changed:eae020e3-68cc-41b2-b34f-a030ba6e139b for instance f6289419-08d9-4d3f-8178-fe2612830f3c on hv-cinder-84893 Jul 14 11:23:10.260524 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-5bc0c0de-7aaa-4396-8a5c-691ee9d3e0a8 req-45c1a7e9-e882-4ee0-a95d-299f45c1aa10 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066144 Jul 14 11:23:10.261797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 551/1096] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:23:11.640485 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b4988d20-cc73-4996-b276-e20968826443 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:11.641054 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b4988d20-cc73-4996-b276-e20968826443 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:11.647139 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4988d20-cc73-4996-b276-e20968826443 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.647634 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4988d20-cc73-4996-b276-e20968826443 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.648408 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4988d20-cc73-4996-b276-e20968826443 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.648847 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4988d20-cc73-4996-b276-e20968826443 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.729650 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-b4988d20-cc73-4996-b276-e20968826443 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lazy-loading 'services' on Instance uuid f6289419-08d9-4d3f-8178-fe2612830f3c {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:23:11.802675 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b4988d20-cc73-4996-b276-e20968826443 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments/855288c2-8f54-4b76-a418-b7f338a42680" status: 202 len: 0 microversion: 2.1 time: 0.167145 Jul 14 11:23:11.803284 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 546/1097] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:23:11 2022] DELETE /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments/855288c2-8f54-4b76-a418-b7f338a42680 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:23:11.815511 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-37bf7f80-79de-4a52-9769-3fc3d2f16501 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:11.817310 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-37bf7f80-79de-4a52-9769-3fc3d2f16501 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:11.828372 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37bf7f80-79de-4a52-9769-3fc3d2f16501 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.828832 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37bf7f80-79de-4a52-9769-3fc3d2f16501 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.829625 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37bf7f80-79de-4a52-9769-3fc3d2f16501 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.830066 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37bf7f80-79de-4a52-9769-3fc3d2f16501 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.863064 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-37bf7f80-79de-4a52-9769-3fc3d2f16501 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053214 Jul 14 11:23:11.863700 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 552/1098] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:23:11 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:23:12.278895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e17ff21a-970b-4c06-b0aa-48b8b61b0890 req-bb8b76f4-b7b7-464a-bb8b-575711d65660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6289419-08d9-4d3f-8178-fe2612830f3c", "tag": "eae020e3-68cc-41b2-b34f-a030ba6e139b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:12.287723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e17ff21a-970b-4c06-b0aa-48b8b61b0890 req-bb8b76f4-b7b7-464a-bb8b-575711d65660 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.288166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e17ff21a-970b-4c06-b0aa-48b8b61b0890 req-bb8b76f4-b7b7-464a-bb8b-575711d65660 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.301920 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e17ff21a-970b-4c06-b0aa-48b8b61b0890 req-bb8b76f4-b7b7-464a-bb8b-575711d65660 service nova] Creating event network-changed:eae020e3-68cc-41b2-b34f-a030ba6e139b for instance f6289419-08d9-4d3f-8178-fe2612830f3c on hv-cinder-84893 Jul 14 11:23:12.307032 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e17ff21a-970b-4c06-b0aa-48b8b61b0890 req-bb8b76f4-b7b7-464a-bb8b-575711d65660 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032706 Jul 14 11:23:12.307677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 547/1099] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:23:12.875440 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d6f940cf-abe8-4a0e-9cb1-a06d29ad5d77 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:12.876252 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d6f940cf-abe8-4a0e-9cb1-a06d29ad5d77 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:12.883188 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6f940cf-abe8-4a0e-9cb1-a06d29ad5d77 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.883665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6f940cf-abe8-4a0e-9cb1-a06d29ad5d77 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.885016 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6f940cf-abe8-4a0e-9cb1-a06d29ad5d77 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.885456 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6f940cf-abe8-4a0e-9cb1-a06d29ad5d77 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.916494 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d6f940cf-abe8-4a0e-9cb1-a06d29ad5d77 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045242 Jul 14 11:23:12.917358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 553/1100] 10.222.0.75 () {58 vars in 1301 bytes} [Thu Jul 14 11:23:12 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:23:12.928561 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:12.929793 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:12.936732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.937203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.938190 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.938624 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:13.023175 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] HTTP exception thrown: Instance f6289419-08d9-4d3f-8178-fe2612830f3c is not attached to volume 855288c2-8f54-4b76-a418-b7f338a42680 Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Request method failure captured: Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments/855288c2-8f54-4b76-a418-b7f338a42680 HTTP/1.1 Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_udbukrR6YNkmizyJEaK4rAR5Kany_vlL2uJgn2ONkzq0XC6VFnyJ2Yfxm1A_ehRGcOdANbUf6HujQxymN0y9kT62jUr_nqGxHY1IKzVX5HmC6e5pu63DnMtBMmi8c0WrY1EuDFc_UcoKSFFNsdiS2ZRljmEUuXMwAFoovsCa94y14 Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 9b0b1b94221f442daa87ea1e3ca55df3 Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestMinimumBasicScenario-1186079168 Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:23:13.026052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9b0b1b94221f442daa87ea1e3ca55df3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9b0b1b94221f442daa87ea1e3ca55df3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b0b1b94221f442daa87ea1e3ca55df3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b0b1b94221f442daa87ea1e3ca55df3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestMinimumBasicScenario-1186079168 Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 9b0b1b94221f442daa87ea1e3ca55df3 Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1186079168 Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-TestMinimumBasicScenario-1186079168-project Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 677282eb944e45d0ae92991660551c4e Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestMinimumBasicScenario-1186079168-project Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:23:13.028914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance f6289419-08d9-4d3f-8178-fe2612830f3c is not attached to volume 855288c2-8f54-4b76-a418-b7f338a42680 Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'server_id': 'f6289419-08d9-4d3f-8178-fe2612830f3c', 'id': '855288c2-8f54-4b76-a418-b7f338a42680'} Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 855288c2-8f54-4b76-a418-b7f338a42680. Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:23:13.030303 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6289419-08d9-4d3f-8178-fe2612830f3c is not attached to volume 855288c2-8f54-4b76-a418-b7f338a42680 Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6289419-08d9-4d3f-8178-fe2612830f3c is not attached to volume 855288c2-8f54-4b76-a418-b7f338a42680 Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:13.033075 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Returning 404 to user: Instance f6289419-08d9-4d3f-8178-fe2612830f3c is not attached to volume 855288c2-8f54-4b76-a418-b7f338a42680 {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:23:13.035186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a2f78da5-39bd-4735-b0b5-e1a4050be528 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments/855288c2-8f54-4b76-a418-b7f338a42680" status: 404 len: 154 microversion: 2.1 time: 0.104031 Jul 14 11:23:13.035186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 548/1101] 10.222.0.75 () {58 vars in 1415 bytes} [Thu Jul 14 11:23:12 2022] DELETE /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c/os-volume_attachments/855288c2-8f54-4b76-a418-b7f338a42680 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:23:14.182478 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-22e445df-916f-43b3-acb9-c6822e8a1f86 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:14.183138 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-22e445df-916f-43b3-acb9-c6822e8a1f86 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:14.190284 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-22e445df-916f-43b3-acb9-c6822e8a1f86 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.190752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-22e445df-916f-43b3-acb9-c6822e8a1f86 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.191588 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-22e445df-916f-43b3-acb9-c6822e8a1f86 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.192030 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-22e445df-916f-43b3-acb9-c6822e8a1f86 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.218604 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-22e445df-916f-43b3-acb9-c6822e8a1f86 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:23:14.315485 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-22e445df-916f-43b3-acb9-c6822e8a1f86 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 204 len: 0 microversion: 2.1 time: 0.137227 Jul 14 11:23:14.317083 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 554/1102] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:23:14 2022] DELETE /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:23:14.325907 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6384cb27-dae1-4d67-8f34-0968124c48f2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:14.326472 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6384cb27-dae1-4d67-8f34-0968124c48f2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:14.333321 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6384cb27-dae1-4d67-8f34-0968124c48f2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.333764 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6384cb27-dae1-4d67-8f34-0968124c48f2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.334533 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6384cb27-dae1-4d67-8f34-0968124c48f2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.334960 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6384cb27-dae1-4d67-8f34-0968124c48f2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.722682 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6384cb27-dae1-4d67-8f34-0968124c48f2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:14.731097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6384cb27-dae1-4d67-8f34-0968124c48f2 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1554 microversion: 2.1 time: 0.409152 Jul 14 11:23:14.731720 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 549/1103] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:14 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1554 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:15.749946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-40796029-cf7b-4627-b560-3207de10258c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:15.750558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-40796029-cf7b-4627-b560-3207de10258c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:15.757212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-40796029-cf7b-4627-b560-3207de10258c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.757754 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-40796029-cf7b-4627-b560-3207de10258c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.758882 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-40796029-cf7b-4627-b560-3207de10258c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.759677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-40796029-cf7b-4627-b560-3207de10258c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.908921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-40796029-cf7b-4627-b560-3207de10258c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:15.917522 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-40796029-cf7b-4627-b560-3207de10258c tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1554 microversion: 2.1 time: 0.171893 Jul 14 11:23:15.918210 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 555/1104] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:15 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:16.935715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc1a0d57-f03d-409b-996e-58e922641d63 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:16.937175 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc1a0d57-f03d-409b-996e-58e922641d63 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:16.946928 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc1a0d57-f03d-409b-996e-58e922641d63 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:16.947799 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc1a0d57-f03d-409b-996e-58e922641d63 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:16.948943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc1a0d57-f03d-409b-996e-58e922641d63 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:16.949662 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc1a0d57-f03d-409b-996e-58e922641d63 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:17.100839 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc1a0d57-f03d-409b-996e-58e922641d63 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677282eb944e45d0ae92991660551c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b1b94221f442daa87ea1e3ca55df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:17.110511 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc1a0d57-f03d-409b-996e-58e922641d63 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 200 len: 1554 microversion: 2.1 time: 0.179996 Jul 14 11:23:17.111108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 550/1105] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:16 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:17.139419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-062d2b5d-576b-4d35-9067-04d0d17a3578 req-f66542dd-0807-4691-a423-b83b478ab48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6289419-08d9-4d3f-8178-fe2612830f3c", "name": "network-vif-deleted", "tag": "eae020e3-68cc-41b2-b34f-a030ba6e139b"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:17.150401 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-062d2b5d-576b-4d35-9067-04d0d17a3578 req-f66542dd-0807-4691-a423-b83b478ab48e service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:17.150401 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-062d2b5d-576b-4d35-9067-04d0d17a3578 req-f66542dd-0807-4691-a423-b83b478ab48e service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:17.162048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-062d2b5d-576b-4d35-9067-04d0d17a3578 req-f66542dd-0807-4691-a423-b83b478ab48e service nova] Creating event network-vif-deleted:eae020e3-68cc-41b2-b34f-a030ba6e139b for instance f6289419-08d9-4d3f-8178-fe2612830f3c on hv-cinder-84893 Jul 14 11:23:17.169008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-062d2b5d-576b-4d35-9067-04d0d17a3578 req-f66542dd-0807-4691-a423-b83b478ab48e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036489 Jul 14 11:23:17.169772 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 556/1106] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:23:18.130341 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:18.131267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] [instance: f6289419-08d9-4d3f-8178-fe2612830f3c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:18.139041 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:18.139529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:18.140332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:18.140777 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:18.160737 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] HTTP exception thrown: Instance f6289419-08d9-4d3f-8178-fe2612830f3c could not be found. Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Request method failure captured: Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c HTTP/1.1 Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_udbukrR6YNkmizyJEaK4rAR5Kany_vlL2uJgn2ONkzq0XC6VFnyJ2Yfxm1A_ehRGcOdANbUf6HujQxymN0y9kT62jUr_nqGxHY1IKzVX5HmC6e5pu63DnMtBMmi8c0WrY1EuDFc_UcoKSFFNsdiS2ZRljmEUuXMwAFoovsCa94y14 Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 9b0b1b94221f442daa87ea1e3ca55df3 Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestMinimumBasicScenario-1186079168 Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:23:18.162333 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9b0b1b94221f442daa87ea1e3ca55df3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9b0b1b94221f442daa87ea1e3ca55df3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b0b1b94221f442daa87ea1e3ca55df3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9b0b1b94221f442daa87ea1e3ca55df3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestMinimumBasicScenario-1186079168 Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 9b0b1b94221f442daa87ea1e3ca55df3 Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1186079168 Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-TestMinimumBasicScenario-1186079168-project Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 677282eb944e45d0ae92991660551c4e Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestMinimumBasicScenario-1186079168-project Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance f6289419-08d9-4d3f-8178-fe2612830f3c could not be found. Jul 14 11:23:18.164073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'f6289419-08d9-4d3f-8178-fe2612830f3c'} Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6289419-08d9-4d3f-8178-fe2612830f3c could not be found. Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:23:18.164887 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6289419-08d9-4d3f-8178-fe2612830f3c could not be found. Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6289419-08d9-4d3f-8178-fe2612830f3c could not be found. Jul 14 11:23:18.166198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:23:18.167730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Returning 404 to user: Instance f6289419-08d9-4d3f-8178-fe2612830f3c could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:23:18.167730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c7c94dab-4f8d-48bd-9da5-bc09d57a2f59 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c" status: 404 len: 111 microversion: 2.1 time: 0.038702 Jul 14 11:23:18.167730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 551/1107] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:18 2022] GET /compute/v2.1/servers/f6289419-08d9-4d3f-8178-fe2612830f3c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:23:18.175457 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5a9a88eb-a09f-4a78-b4bf-5146ae398549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] Calling method '.version_select at 0x7f579e0ab3a0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:18.202609 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5a9a88eb-a09f-4a78-b4bf-5146ae398549 tempest-TestMinimumBasicScenario-1186079168 tempest-TestMinimumBasicScenario-1186079168-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-485601796" status: 202 len: 0 microversion: 2.1 time: 0.032732 Jul 14 11:23:18.203202 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 557/1108] 10.222.0.75 () {58 vars in 1268 bytes} [Thu Jul 14 11:23:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-485601796 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:23:37.900431 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=14 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:37.901647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:38.081836 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3ae60ed8-6733-402f-a5c2-be3a98d4a2e8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Action: 'create', calling method: .version_select at 0x7f579e010c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-2062368623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIdbjPJES17REkGlF0j63Tty1jYv1+Um9eaGYgOb2PIgUOy6EM0dCTqbGdQZZuY1M7+lWIenqBu8cdn+v3HXl7xz1xklSxn7djStRMOxfvnzC25Au6UVo1UnFWTMnq19A=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:38.097514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-3ae60ed8-6733-402f-a5c2-be3a98d4a2e8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Getting quotas for project 67f0b0b647c442b9a682fd37d756400a. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:23:38.101983 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-3ae60ed8-6733-402f-a5c2-be3a98d4a2e8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Getting quotas for user 65c3d05f3b904c0f999984dda155f1cf and project 67f0b0b647c442b9a682fd37d756400a. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:23:38.115914 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3ae60ed8-6733-402f-a5c2-be3a98d4a2e8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [d33b48ac-a706-467f-8b56-fbd93ae95fc8] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 11:23:39.124516 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [None req-3ae60ed8-6733-402f-a5c2-be3a98d4a2e8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [d33b48ac-a706-467f-8b56-fbd93ae95fc8] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 45268. Jul 14 11:23:39.141506 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3ae60ed8-6733-402f-a5c2-be3a98d4a2e8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.246590 Jul 14 11:23:39.142112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 552/1109] 10.222.0.75 () {60 vars in 1158 bytes} [Thu Jul 14 11:23:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:24:01.708908 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:01.709656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:01.713843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1589851101", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2062368623", "security_groups": [{"name": "tempest-secgroup-smoke-2047056091"}], "networks": [{"uuid": "ead00b99-19ce-4452-ac14-f28ed397e4b0"}], "block_device_mapping_v2": [{"uuid": "7efc6041-5102-47b1-a0ef-c38cbeaa848b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:01.832767 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] validate_networks() for [('ead00b99-19ce-4452-ac14-f28ed397e4b0', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:24:02.207575 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:24:02.208001 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:24:02.208475 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:24:02.208887 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:24:02.209291 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:24:02.218089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:02.218531 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:02.219362 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:02.219826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:02.236988 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Getting quotas for project 67f0b0b647c442b9a682fd37d756400a. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:24:02.241038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Getting quotas for user 65c3d05f3b904c0f999984dda155f1cf and project 67f0b0b647c442b9a682fd37d756400a. Resources: {'instances', 'ram', 'cores'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:24:02.297413 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:24:02.300229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7efc6041-5102-47b1-a0ef-c38cbeaa848b',volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:24:02.425548 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-286c0aa6-bf54-4085-bdcf-5afe8a6e356e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718078 Jul 14 11:24:02.426364 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 558/1110] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:24:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:24:02.436707 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3bbcdc06-8b0a-4090-b037-0a73371080f7 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:02.437395 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3bbcdc06-8b0a-4090-b037-0a73371080f7 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:02.440106 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:02.440901 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:02.497532 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3bbcdc06-8b0a-4090-b037-0a73371080f7 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:02.504463 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3bbcdc06-8b0a-4090-b037-0a73371080f7 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1089 microversion: 2.1 time: 0.071937 Jul 14 11:24:02.505061 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 553/1111] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:02 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:03.522794 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-611749b7-1148-45fd-8f9e-5825f18f3911 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:03.523547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-611749b7-1148-45fd-8f9e-5825f18f3911 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:03.530709 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-611749b7-1148-45fd-8f9e-5825f18f3911 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:03.531162 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-611749b7-1148-45fd-8f9e-5825f18f3911 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:03.531986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-611749b7-1148-45fd-8f9e-5825f18f3911 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:03.532425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-611749b7-1148-45fd-8f9e-5825f18f3911 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:03.649574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-611749b7-1148-45fd-8f9e-5825f18f3911 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:03.656977 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-611749b7-1148-45fd-8f9e-5825f18f3911 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1205 microversion: 2.1 time: 0.138622 Jul 14 11:24:03.657552 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 559/1112] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:03 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1205 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:04.674470 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ad08b6bc-a079-4145-ba6a-ceda91232c4b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:04.675202 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ad08b6bc-a079-4145-ba6a-ceda91232c4b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:04.682262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad08b6bc-a079-4145-ba6a-ceda91232c4b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:04.682988 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad08b6bc-a079-4145-ba6a-ceda91232c4b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:04.683989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad08b6bc-a079-4145-ba6a-ceda91232c4b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:04.684696 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad08b6bc-a079-4145-ba6a-ceda91232c4b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:04.820818 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-7f9aff97-6266-4a9b-8b2c-3ac77777e0ca req-250e94d6-faba-44d5-b039-66f15a888a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566c5bd4-998b-48a8-90e3-69d2fee07a54", "tag": "4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:04.833504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-7f9aff97-6266-4a9b-8b2c-3ac77777e0ca req-250e94d6-faba-44d5-b039-66f15a888a45 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:04.833862 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-7f9aff97-6266-4a9b-8b2c-3ac77777e0ca req-250e94d6-faba-44d5-b039-66f15a888a45 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:04.848589 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-7f9aff97-6266-4a9b-8b2c-3ac77777e0ca req-250e94d6-faba-44d5-b039-66f15a888a45 service nova] Creating event network-changed:4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1 for instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 on hv-cinder-84893 Jul 14 11:24:04.854535 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-7f9aff97-6266-4a9b-8b2c-3ac77777e0ca req-250e94d6-faba-44d5-b039-66f15a888a45 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039043 Jul 14 11:24:04.855283 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 560/1113] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:24:04.861273 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ad08b6bc-a079-4145-ba6a-ceda91232c4b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:04.869112 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ad08b6bc-a079-4145-ba6a-ceda91232c4b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.199036 Jul 14 11:24:04.869688 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 554/1114] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:04 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:05.887228 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6e6ac104-e255-4ba5-801a-ae53cf794722 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:05.887969 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6e6ac104-e255-4ba5-801a-ae53cf794722 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:05.895015 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e6ac104-e255-4ba5-801a-ae53cf794722 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:05.895490 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e6ac104-e255-4ba5-801a-ae53cf794722 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:05.896265 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e6ac104-e255-4ba5-801a-ae53cf794722 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:05.896702 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e6ac104-e255-4ba5-801a-ae53cf794722 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:06.027146 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6e6ac104-e255-4ba5-801a-ae53cf794722 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:06.034912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6e6ac104-e255-4ba5-801a-ae53cf794722 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.152333 Jul 14 11:24:06.035498 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 561/1115] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:05 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:07.052890 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-546a315a-575c-4299-b061-93634ae4c442 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:07.053461 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-546a315a-575c-4299-b061-93634ae4c442 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:07.061275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-546a315a-575c-4299-b061-93634ae4c442 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:07.061729 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-546a315a-575c-4299-b061-93634ae4c442 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:07.062569 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-546a315a-575c-4299-b061-93634ae4c442 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:07.063014 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-546a315a-575c-4299-b061-93634ae4c442 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:07.213772 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-546a315a-575c-4299-b061-93634ae4c442 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:07.221560 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-546a315a-575c-4299-b061-93634ae4c442 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.172853 Jul 14 11:24:07.222148 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 555/1116] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:07 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:08.238282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-66ac8c0b-2f06-4ec8-90dc-a33429cda9c3 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:08.238974 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-66ac8c0b-2f06-4ec8-90dc-a33429cda9c3 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:08.245649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-66ac8c0b-2f06-4ec8-90dc-a33429cda9c3 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:08.246090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-66ac8c0b-2f06-4ec8-90dc-a33429cda9c3 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:08.246855 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-66ac8c0b-2f06-4ec8-90dc-a33429cda9c3 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:08.247282 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-66ac8c0b-2f06-4ec8-90dc-a33429cda9c3 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:08.402263 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-66ac8c0b-2f06-4ec8-90dc-a33429cda9c3 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:08.410141 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-66ac8c0b-2f06-4ec8-90dc-a33429cda9c3 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.175773 Jul 14 11:24:08.410722 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 562/1117] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:08 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:09.427951 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cad73ba9-9aa2-4391-b816-495e599de28e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:09.428565 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cad73ba9-9aa2-4391-b816-495e599de28e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:09.435336 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cad73ba9-9aa2-4391-b816-495e599de28e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:09.435825 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cad73ba9-9aa2-4391-b816-495e599de28e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:09.436596 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cad73ba9-9aa2-4391-b816-495e599de28e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:09.437033 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cad73ba9-9aa2-4391-b816-495e599de28e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:09.578822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cad73ba9-9aa2-4391-b816-495e599de28e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:09.586766 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cad73ba9-9aa2-4391-b816-495e599de28e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.162635 Jul 14 11:24:09.587356 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 556/1118] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:09 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:10.603829 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0ace0413-ee9c-4423-82bf-fea87bad0ab5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:10.604434 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0ace0413-ee9c-4423-82bf-fea87bad0ab5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:10.610867 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ace0413-ee9c-4423-82bf-fea87bad0ab5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:10.611313 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ace0413-ee9c-4423-82bf-fea87bad0ab5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:10.612100 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ace0413-ee9c-4423-82bf-fea87bad0ab5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:10.612533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0ace0413-ee9c-4423-82bf-fea87bad0ab5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:10.755851 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0ace0413-ee9c-4423-82bf-fea87bad0ab5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:10.763431 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0ace0413-ee9c-4423-82bf-fea87bad0ab5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.163427 Jul 14 11:24:10.764003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 563/1119] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:10 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:11.780614 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f8cbdaa-e8ec-4dda-b652-7a092f028601 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:11.781221 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8f8cbdaa-e8ec-4dda-b652-7a092f028601 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:11.787849 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8cbdaa-e8ec-4dda-b652-7a092f028601 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:11.788298 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8cbdaa-e8ec-4dda-b652-7a092f028601 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:11.789059 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8cbdaa-e8ec-4dda-b652-7a092f028601 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:11.789496 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8cbdaa-e8ec-4dda-b652-7a092f028601 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:11.924238 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f8cbdaa-e8ec-4dda-b652-7a092f028601 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:11.931821 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8f8cbdaa-e8ec-4dda-b652-7a092f028601 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.155017 Jul 14 11:24:11.932387 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 557/1120] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:11 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:12.948917 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-714ee53d-ef86-454e-8ed0-32d7a06295a8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:12.949534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-714ee53d-ef86-454e-8ed0-32d7a06295a8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:12.952033 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:12.952717 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:12.960026 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-714ee53d-ef86-454e-8ed0-32d7a06295a8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:12.960482 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-714ee53d-ef86-454e-8ed0-32d7a06295a8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:12.961256 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-714ee53d-ef86-454e-8ed0-32d7a06295a8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:12.961698 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-714ee53d-ef86-454e-8ed0-32d7a06295a8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:13.093151 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-714ee53d-ef86-454e-8ed0-32d7a06295a8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:13.101326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-714ee53d-ef86-454e-8ed0-32d7a06295a8 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.156290 Jul 14 11:24:13.101889 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 564/1121] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:12 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:14.118237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a30d9605-9d62-4a02-9ff1-107d634a86be tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:14.118834 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a30d9605-9d62-4a02-9ff1-107d634a86be tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:14.120971 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:14.128291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a30d9605-9d62-4a02-9ff1-107d634a86be tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:14.128742 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a30d9605-9d62-4a02-9ff1-107d634a86be tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:14.129528 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a30d9605-9d62-4a02-9ff1-107d634a86be tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:14.129968 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a30d9605-9d62-4a02-9ff1-107d634a86be tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:14.272924 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a30d9605-9d62-4a02-9ff1-107d634a86be tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:14.280916 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a30d9605-9d62-4a02-9ff1-107d634a86be tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.166450 Jul 14 11:24:14.281504 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 558/1122] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:14 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:14.412474 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-8b9b2ded-3439-44ba-886f-aa9b26c4a85c req-94e8d20a-e255-4dce-96ec-c5e6f7896aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566c5bd4-998b-48a8-90e3-69d2fee07a54", "name": "network-vif-plugged", "status": "completed", "tag": "4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:14.422237 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-8b9b2ded-3439-44ba-886f-aa9b26c4a85c req-94e8d20a-e255-4dce-96ec-c5e6f7896aed service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:14.423321 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-8b9b2ded-3439-44ba-886f-aa9b26c4a85c req-94e8d20a-e255-4dce-96ec-c5e6f7896aed service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:14.436773 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-8b9b2ded-3439-44ba-886f-aa9b26c4a85c req-94e8d20a-e255-4dce-96ec-c5e6f7896aed service nova] Creating event network-vif-plugged:4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1 for instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 on hv-cinder-84893 Jul 14 11:24:14.442243 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-8b9b2ded-3439-44ba-886f-aa9b26c4a85c req-94e8d20a-e255-4dce-96ec-c5e6f7896aed service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Jul 14 11:24:14.443264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 565/1123] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:24:15.299343 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-49d263cb-99bc-4167-828e-e8f8494afd54 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:15.299966 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-49d263cb-99bc-4167-828e-e8f8494afd54 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:15.307010 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49d263cb-99bc-4167-828e-e8f8494afd54 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:15.307491 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49d263cb-99bc-4167-828e-e8f8494afd54 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:15.308278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49d263cb-99bc-4167-828e-e8f8494afd54 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:15.308723 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49d263cb-99bc-4167-828e-e8f8494afd54 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:15.449954 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-49d263cb-99bc-4167-828e-e8f8494afd54 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:15.458377 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-49d263cb-99bc-4167-828e-e8f8494afd54 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1261 microversion: 2.1 time: 0.162904 Jul 14 11:24:15.458943 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 559/1124] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:15 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:16.479371 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-df1f72f9-c4d0-4f3b-8b5b-8edc34b9d31e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:16.480534 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-df1f72f9-c4d0-4f3b-8b5b-8edc34b9d31e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:16.489530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df1f72f9-c4d0-4f3b-8b5b-8edc34b9d31e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:16.489987 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df1f72f9-c4d0-4f3b-8b5b-8edc34b9d31e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:16.490779 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df1f72f9-c4d0-4f3b-8b5b-8edc34b9d31e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:16.491218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df1f72f9-c4d0-4f3b-8b5b-8edc34b9d31e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:16.644788 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-df1f72f9-c4d0-4f3b-8b5b-8edc34b9d31e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:16.654521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-df1f72f9-c4d0-4f3b-8b5b-8edc34b9d31e tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1445 microversion: 2.1 time: 0.182022 Jul 14 11:24:16.654521 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 566/1125] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:16 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1445 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:16.670814 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7c031d78-6bb7-4a3c-8ddd-3770927e4403 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:16.671501 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7c031d78-6bb7-4a3c-8ddd-3770927e4403 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:16.679124 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c031d78-6bb7-4a3c-8ddd-3770927e4403 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:16.679494 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c031d78-6bb7-4a3c-8ddd-3770927e4403 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:16.680286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c031d78-6bb7-4a3c-8ddd-3770927e4403 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:16.680823 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c031d78-6bb7-4a3c-8ddd-3770927e4403 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:16.839344 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7c031d78-6bb7-4a3c-8ddd-3770927e4403 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:16.849163 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7c031d78-6bb7-4a3c-8ddd-3770927e4403 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1445 microversion: 2.1 time: 0.183540 Jul 14 11:24:16.849755 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 560/1126] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:16 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:18.551830 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:24:18.552712 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Thu Jul 14 11:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:24:18.741109 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-33dbcdae-db95-4e4c-a945-9a4d7a21597c req-59642d65-3b47-4244-81a5-408237c5c082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566c5bd4-998b-48a8-90e3-69d2fee07a54", "tag": "4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:18.752006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-33dbcdae-db95-4e4c-a945-9a4d7a21597c req-59642d65-3b47-4244-81a5-408237c5c082 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:18.752518 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-33dbcdae-db95-4e4c-a945-9a4d7a21597c req-59642d65-3b47-4244-81a5-408237c5c082 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:18.764429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-33dbcdae-db95-4e4c-a945-9a4d7a21597c req-59642d65-3b47-4244-81a5-408237c5c082 service nova] Creating event network-changed:4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1 for instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 on hv-cinder-84893 Jul 14 11:24:18.770414 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-33dbcdae-db95-4e4c-a945-9a4d7a21597c req-59642d65-3b47-4244-81a5-408237c5c082 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032863 Jul 14 11:24:18.771424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 567/1127] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:24:47.050393 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ac738fb0-3824-4566-8717-6df53393641f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:47.051107 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ac738fb0-3824-4566-8717-6df53393641f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:47.052982 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=18 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:47.054350 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=42 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:47.059805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac738fb0-3824-4566-8717-6df53393641f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:47.060508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac738fb0-3824-4566-8717-6df53393641f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:47.061263 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac738fb0-3824-4566-8717-6df53393641f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:47.061691 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac738fb0-3824-4566-8717-6df53393641f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:47.099347 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ac738fb0-3824-4566-8717-6df53393641f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:24:47.178751 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ac738fb0-3824-4566-8717-6df53393641f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 204 len: 0 microversion: 2.1 time: 0.131512 Jul 14 11:24:47.179332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 561/1128] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:24:47 2022] DELETE /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:24:47.189229 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9a600939-19bb-4de1-90d2-8e5c07d81ee4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:47.190024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9a600939-19bb-4de1-90d2-8e5c07d81ee4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:47.192258 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:47.192902 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=44 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:47.199905 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a600939-19bb-4de1-90d2-8e5c07d81ee4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:47.200358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a600939-19bb-4de1-90d2-8e5c07d81ee4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:47.201132 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a600939-19bb-4de1-90d2-8e5c07d81ee4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:47.201567 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a600939-19bb-4de1-90d2-8e5c07d81ee4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:47.334063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9a600939-19bb-4de1-90d2-8e5c07d81ee4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:47.342210 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9a600939-19bb-4de1-90d2-8e5c07d81ee4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1579 microversion: 2.1 time: 0.158223 Jul 14 11:24:47.342778 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 568/1129] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:47 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:48.360893 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88007af2-ff17-481a-a0d2-6dd5bebedd99 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:48.361540 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88007af2-ff17-481a-a0d2-6dd5bebedd99 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:48.368014 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88007af2-ff17-481a-a0d2-6dd5bebedd99 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:48.368466 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88007af2-ff17-481a-a0d2-6dd5bebedd99 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:48.369332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88007af2-ff17-481a-a0d2-6dd5bebedd99 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:48.369663 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88007af2-ff17-481a-a0d2-6dd5bebedd99 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:48.504656 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88007af2-ff17-481a-a0d2-6dd5bebedd99 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:48.513261 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88007af2-ff17-481a-a0d2-6dd5bebedd99 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1579 microversion: 2.1 time: 0.156576 Jul 14 11:24:48.513845 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 562/1130] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:48 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:49.529950 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2da913c7-8944-4cee-8508-a11e66f45227 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:49.530582 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2da913c7-8944-4cee-8508-a11e66f45227 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:49.537048 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2da913c7-8944-4cee-8508-a11e66f45227 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:49.538024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2da913c7-8944-4cee-8508-a11e66f45227 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:49.538789 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2da913c7-8944-4cee-8508-a11e66f45227 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:49.539235 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2da913c7-8944-4cee-8508-a11e66f45227 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:50.024706 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2da913c7-8944-4cee-8508-a11e66f45227 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:50.033024 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2da913c7-8944-4cee-8508-a11e66f45227 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 200 len: 1579 microversion: 2.1 time: 0.506819 Jul 14 11:24:50.033880 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 569/1131] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:49 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 1579 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:50.326216 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-bcc7c7c0-7c3e-4741-93d6-6699df5ae6f6 req-572c7e54-ea88-4e5e-b0e2-2def5ccc576b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e09bb3-a737-40f6-b960-8d581524e93a", "name": "network-vif-deleted", "tag": "c42476bd-315b-4076-a2d2-9a430b4c7ec7"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:50.336186 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-bcc7c7c0-7c3e-4741-93d6-6699df5ae6f6 req-572c7e54-ea88-4e5e-b0e2-2def5ccc576b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:50.336759 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-bcc7c7c0-7c3e-4741-93d6-6699df5ae6f6 req-572c7e54-ea88-4e5e-b0e2-2def5ccc576b service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:50.348306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-bcc7c7c0-7c3e-4741-93d6-6699df5ae6f6 req-572c7e54-ea88-4e5e-b0e2-2def5ccc576b service nova] Creating event network-vif-deleted:c42476bd-315b-4076-a2d2-9a430b4c7ec7 for instance a7e09bb3-a737-40f6-b960-8d581524e93a on hv-cinder-84893 Jul 14 11:24:50.353902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-bcc7c7c0-7c3e-4741-93d6-6699df5ae6f6 req-572c7e54-ea88-4e5e-b0e2-2def5ccc576b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098018 Jul 14 11:24:50.354563 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 563/1132] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:24:51.050346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:51.051148 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:51.059062 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:51.059726 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:51.060946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:51.061525 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:51.076549 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] HTTP exception thrown: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Request method failure captured: Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a HTTP/1.1 Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_wbYo6UXWUBTVC7kydSGk_pbaQC2Er5lBw0rgu3SHTt9xRdEBaryd9qy3JdDXjWYUCHkRnlHtCYcsOb8cEH0T_a_LxkltTj4RoiKZkc-3A-lLfCGiI4LTCO6F9y9gelpmZKakmgpIOtukKnpFZ780JPdV1zc9DSIMU4fAXpKVSlgaw Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:24:51.078212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_67f41dcdf6564bbd910a2285568941a1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-TestVolumeBootPattern-870017182 Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: d942201423da427b848dfd44b33358b8 Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:24:51.080090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'a7e09bb3-a737-40f6-b960-8d581524e93a'} Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:24:51.081373 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:24:51.083945 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:24:51.086438 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Returning 404 to user: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:24:51.086438 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c99be478-3e3d-4d26-a168-87ba1c8e09d6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 404 len: 111 microversion: 2.1 time: 0.033486 Jul 14 11:24:51.086438 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 570/1133] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:51 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:24:51.186047 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1183446796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2122659772", "security_groups": [{"name": "tempest-secgroup-smoke-1504150156"}], "block_device_mapping_v2": [{"uuid": "4246e54e-4aeb-4808-ae5f-ea3bf651571a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba59ba1e-7990-4ba9-88ad-652628c8e3ee"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:51.300656 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] validate_networks() for [('ba59ba1e-7990-4ba9-88ad-652628c8e3ee', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:24:51.674115 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:24:51.674715 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:24:51.675006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:24:51.675480 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:24:51.675898 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:24:51.684630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:51.685344 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:51.686156 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:51.686595 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:51.703781 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Getting quotas for project 67f41dcdf6564bbd910a2285568941a1. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:24:51.707748 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Getting quotas for user d942201423da427b848dfd44b33358b8 and project 67f41dcdf6564bbd910a2285568941a1. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:24:51.764901 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:24:51.767278 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4246e54e-4aeb-4808-ae5f-ea3bf651571a',volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:24:51.892489 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-506cff75-1300-498e-8138-0fb1260241f1 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711123 Jul 14 11:24:51.893134 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 564/1134] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:24:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:24:51.903452 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bce59ed7-9fe6-4b5a-a514-3f82d8692115 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:51.904113 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bce59ed7-9fe6-4b5a-a514-3f82d8692115 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:51.963158 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bce59ed7-9fe6-4b5a-a514-3f82d8692115 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:51.969713 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bce59ed7-9fe6-4b5a-a514-3f82d8692115 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1095 microversion: 2.1 time: 0.070054 Jul 14 11:24:51.970299 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 571/1135] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:51 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:52.986684 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d8c63a52-95b1-47f2-b45a-52785c95e326 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:52.987615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d8c63a52-95b1-47f2-b45a-52785c95e326 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:52.994743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8c63a52-95b1-47f2-b45a-52785c95e326 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:52.995346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8c63a52-95b1-47f2-b45a-52785c95e326 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:52.996291 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8c63a52-95b1-47f2-b45a-52785c95e326 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:52.996835 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8c63a52-95b1-47f2-b45a-52785c95e326 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:53.067875 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d8c63a52-95b1-47f2-b45a-52785c95e326 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:53.076664 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d8c63a52-95b1-47f2-b45a-52785c95e326 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1201 microversion: 2.1 time: 0.093804 Jul 14 11:24:53.077362 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 565/1136] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:52 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:54.094629 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a640a51e-be3d-4061-9b68-b43b83a1858a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:54.095240 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a640a51e-be3d-4061-9b68-b43b83a1858a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:54.102439 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a640a51e-be3d-4061-9b68-b43b83a1858a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:54.102897 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a640a51e-be3d-4061-9b68-b43b83a1858a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:54.103693 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a640a51e-be3d-4061-9b68-b43b83a1858a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:54.104130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a640a51e-be3d-4061-9b68-b43b83a1858a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:54.330543 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a640a51e-be3d-4061-9b68-b43b83a1858a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:54.338844 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a640a51e-be3d-4061-9b68-b43b83a1858a tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.247954 Jul 14 11:24:54.339330 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 572/1137] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:54 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:54.488584 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-40fa3e57-eec5-4527-8d80-0f1aaaee499e req-72a4f4a8-6290-44a7-9c6a-8f7d0f444903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df984ff-60fe-4926-9fdb-e33a4fdc82e2", "tag": "604e5f5c-283e-45f1-a867-13e08aeec016"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:54.516946 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-40fa3e57-eec5-4527-8d80-0f1aaaee499e req-72a4f4a8-6290-44a7-9c6a-8f7d0f444903 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:54.517711 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-40fa3e57-eec5-4527-8d80-0f1aaaee499e req-72a4f4a8-6290-44a7-9c6a-8f7d0f444903 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:54.532555 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-40fa3e57-eec5-4527-8d80-0f1aaaee499e req-72a4f4a8-6290-44a7-9c6a-8f7d0f444903 service nova] Creating event network-changed:604e5f5c-283e-45f1-a867-13e08aeec016 for instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 on hv-cinder-84893 Jul 14 11:24:54.540323 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-40fa3e57-eec5-4527-8d80-0f1aaaee499e req-72a4f4a8-6290-44a7-9c6a-8f7d0f444903 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055613 Jul 14 11:24:54.541249 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 566/1138] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:24:55.355909 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9072069b-0e3a-4736-9068-5ebdac8db254 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:55.356516 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9072069b-0e3a-4736-9068-5ebdac8db254 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:55.362980 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9072069b-0e3a-4736-9068-5ebdac8db254 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:55.363451 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9072069b-0e3a-4736-9068-5ebdac8db254 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:55.364219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9072069b-0e3a-4736-9068-5ebdac8db254 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:55.364657 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9072069b-0e3a-4736-9068-5ebdac8db254 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:55.494355 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9072069b-0e3a-4736-9068-5ebdac8db254 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:55.502243 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9072069b-0e3a-4736-9068-5ebdac8db254 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.150221 Jul 14 11:24:55.502818 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 573/1139] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:55 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:56.520067 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0311a000-dd8b-4924-a49e-bb948383ebc7 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:56.520768 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0311a000-dd8b-4924-a49e-bb948383ebc7 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:56.527516 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0311a000-dd8b-4924-a49e-bb948383ebc7 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:56.527970 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0311a000-dd8b-4924-a49e-bb948383ebc7 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:56.528732 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0311a000-dd8b-4924-a49e-bb948383ebc7 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:56.529176 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0311a000-dd8b-4924-a49e-bb948383ebc7 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:56.659716 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0311a000-dd8b-4924-a49e-bb948383ebc7 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:56.667296 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0311a000-dd8b-4924-a49e-bb948383ebc7 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.151436 Jul 14 11:24:56.667896 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 567/1140] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:56 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:57.684318 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-66a4d582-787b-4167-807d-f5aaac4c25aa tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:57.685182 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-66a4d582-787b-4167-807d-f5aaac4c25aa tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:57.692074 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-66a4d582-787b-4167-807d-f5aaac4c25aa tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:57.692526 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-66a4d582-787b-4167-807d-f5aaac4c25aa tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:57.693285 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-66a4d582-787b-4167-807d-f5aaac4c25aa tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:57.694220 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-66a4d582-787b-4167-807d-f5aaac4c25aa tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:57.828066 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-66a4d582-787b-4167-807d-f5aaac4c25aa tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:57.836146 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-66a4d582-787b-4167-807d-f5aaac4c25aa tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.155694 Jul 14 11:24:57.836714 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 574/1141] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:57 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:58.852810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ac2dfcef-68bd-4d8c-9e28-957118f5a928 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:58.853407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ac2dfcef-68bd-4d8c-9e28-957118f5a928 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:58.859913 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac2dfcef-68bd-4d8c-9e28-957118f5a928 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:58.860355 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac2dfcef-68bd-4d8c-9e28-957118f5a928 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:58.861100 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac2dfcef-68bd-4d8c-9e28-957118f5a928 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:58.861527 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac2dfcef-68bd-4d8c-9e28-957118f5a928 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:58.991824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ac2dfcef-68bd-4d8c-9e28-957118f5a928 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:58.999305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ac2dfcef-68bd-4d8c-9e28-957118f5a928 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.150347 Jul 14 11:24:58.999901 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 568/1142] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:58 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:00.016067 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-16e15b5c-096e-423e-877c-7ddb2c13161d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:00.016693 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-16e15b5c-096e-423e-877c-7ddb2c13161d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:00.023084 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-16e15b5c-096e-423e-877c-7ddb2c13161d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:00.023559 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-16e15b5c-096e-423e-877c-7ddb2c13161d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:00.024310 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-16e15b5c-096e-423e-877c-7ddb2c13161d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:00.024740 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-16e15b5c-096e-423e-877c-7ddb2c13161d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:00.155758 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-16e15b5c-096e-423e-877c-7ddb2c13161d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:00.163812 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-16e15b5c-096e-423e-877c-7ddb2c13161d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.151617 Jul 14 11:25:00.164379 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 575/1143] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:00 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:01.181451 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-01381ba6-d28f-4981-8b16-4f250f5c06e8 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:01.182058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-01381ba6-d28f-4981-8b16-4f250f5c06e8 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:01.188813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01381ba6-d28f-4981-8b16-4f250f5c06e8 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:01.189269 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01381ba6-d28f-4981-8b16-4f250f5c06e8 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:01.190036 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01381ba6-d28f-4981-8b16-4f250f5c06e8 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:01.190473 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01381ba6-d28f-4981-8b16-4f250f5c06e8 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:01.341403 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-01381ba6-d28f-4981-8b16-4f250f5c06e8 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:01.348972 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-01381ba6-d28f-4981-8b16-4f250f5c06e8 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.171922 Jul 14 11:25:01.349534 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 569/1144] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:01 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:02.366006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c0e67fd0-2f00-46b8-98a5-1c8f2267cfea tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:02.366613 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c0e67fd0-2f00-46b8-98a5-1c8f2267cfea tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:02.368946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:02.374547 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0e67fd0-2f00-46b8-98a5-1c8f2267cfea tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:02.375002 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0e67fd0-2f00-46b8-98a5-1c8f2267cfea tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:02.375817 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0e67fd0-2f00-46b8-98a5-1c8f2267cfea tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:02.376256 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0e67fd0-2f00-46b8-98a5-1c8f2267cfea tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:02.515995 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c0e67fd0-2f00-46b8-98a5-1c8f2267cfea tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:02.524369 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c0e67fd0-2f00-46b8-98a5-1c8f2267cfea tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.162151 Jul 14 11:25:02.525274 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 576/1145] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:02 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:03.542123 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef037c5c-af0a-433c-a5ca-8aeb3daad3ae tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:03.542724 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef037c5c-af0a-433c-a5ca-8aeb3daad3ae tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:03.544752 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:03.545424 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:03.551824 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef037c5c-af0a-433c-a5ca-8aeb3daad3ae tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:03.552277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef037c5c-af0a-433c-a5ca-8aeb3daad3ae tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:03.553713 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef037c5c-af0a-433c-a5ca-8aeb3daad3ae tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:03.554271 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef037c5c-af0a-433c-a5ca-8aeb3daad3ae tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:03.692800 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ef037c5c-af0a-433c-a5ca-8aeb3daad3ae tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:03.700462 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ef037c5c-af0a-433c-a5ca-8aeb3daad3ae tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.162902 Jul 14 11:25:03.701028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 570/1146] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:03 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:04.717427 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-18d83c27-41d1-44a4-a78e-7ad24d2db83d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:04.718259 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-18d83c27-41d1-44a4-a78e-7ad24d2db83d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:04.725672 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18d83c27-41d1-44a4-a78e-7ad24d2db83d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:04.726212 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18d83c27-41d1-44a4-a78e-7ad24d2db83d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:04.727219 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18d83c27-41d1-44a4-a78e-7ad24d2db83d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:04.727698 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18d83c27-41d1-44a4-a78e-7ad24d2db83d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:04.735321 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-0ae21460-7a8c-4f3f-83ba-7b75dc2c9b11 req-0f826c15-0f2b-4e12-b56e-288d41a18008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df984ff-60fe-4926-9fdb-e33a4fdc82e2", "name": "network-vif-plugged", "status": "completed", "tag": "604e5f5c-283e-45f1-a867-13e08aeec016"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:04.744106 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-0ae21460-7a8c-4f3f-83ba-7b75dc2c9b11 req-0f826c15-0f2b-4e12-b56e-288d41a18008 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:04.744555 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-0ae21460-7a8c-4f3f-83ba-7b75dc2c9b11 req-0f826c15-0f2b-4e12-b56e-288d41a18008 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:04.755425 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-0ae21460-7a8c-4f3f-83ba-7b75dc2c9b11 req-0f826c15-0f2b-4e12-b56e-288d41a18008 service nova] Creating event network-vif-plugged:604e5f5c-283e-45f1-a867-13e08aeec016 for instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 on hv-cinder-84893 Jul 14 11:25:04.762096 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-0ae21460-7a8c-4f3f-83ba-7b75dc2c9b11 req-0f826c15-0f2b-4e12-b56e-288d41a18008 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094057 Jul 14 11:25:04.762635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 577/1147] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:25:04.867189 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-18d83c27-41d1-44a4-a78e-7ad24d2db83d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:04.874644 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-18d83c27-41d1-44a4-a78e-7ad24d2db83d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.161312 Jul 14 11:25:04.876084 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 571/1148] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:04 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:25:05.893088 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3996c6b2-ed64-4bb0-b951-4aaaaf347a38 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:05.893823 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3996c6b2-ed64-4bb0-b951-4aaaaf347a38 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:05.900655 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3996c6b2-ed64-4bb0-b951-4aaaaf347a38 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:05.901109 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3996c6b2-ed64-4bb0-b951-4aaaaf347a38 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:05.901875 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3996c6b2-ed64-4bb0-b951-4aaaaf347a38 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:05.902315 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3996c6b2-ed64-4bb0-b951-4aaaaf347a38 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:06.034450 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3996c6b2-ed64-4bb0-b951-4aaaaf347a38 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:06.042054 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3996c6b2-ed64-4bb0-b951-4aaaaf347a38 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1267 microversion: 2.1 time: 0.153698 Jul 14 11:25:06.042672 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 578/1149] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:05 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:07.059241 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d331db88-e1da-42ae-a4f7-feb14b188688 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:07.059921 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d331db88-e1da-42ae-a4f7-feb14b188688 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:07.066750 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d331db88-e1da-42ae-a4f7-feb14b188688 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:07.067198 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d331db88-e1da-42ae-a4f7-feb14b188688 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:07.068001 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d331db88-e1da-42ae-a4f7-feb14b188688 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:07.068439 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d331db88-e1da-42ae-a4f7-feb14b188688 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:07.199338 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d331db88-e1da-42ae-a4f7-feb14b188688 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:07.206828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d331db88-e1da-42ae-a4f7-feb14b188688 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1455 microversion: 2.1 time: 0.151644 Jul 14 11:25:07.207402 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 572/1150] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:07 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:07.224335 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7e8633cc-4218-4577-b237-eecfd4d63a6f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:07.225009 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7e8633cc-4218-4577-b237-eecfd4d63a6f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:07.230981 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7e8633cc-4218-4577-b237-eecfd4d63a6f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:07.231465 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7e8633cc-4218-4577-b237-eecfd4d63a6f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:07.232238 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7e8633cc-4218-4577-b237-eecfd4d63a6f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:07.232673 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7e8633cc-4218-4577-b237-eecfd4d63a6f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:07.377752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7e8633cc-4218-4577-b237-eecfd4d63a6f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:07.386172 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7e8633cc-4218-4577-b237-eecfd4d63a6f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1455 microversion: 2.1 time: 0.166157 Jul 14 11:25:07.386752 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 579/1151] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:07 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:09.356427 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-cb2d5ffb-2e3a-4249-b95f-3acebb103621 req-79ba592b-72d4-4f18-a91d-4355694e0b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df984ff-60fe-4926-9fdb-e33a4fdc82e2", "tag": "604e5f5c-283e-45f1-a867-13e08aeec016"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:09.367232 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-cb2d5ffb-2e3a-4249-b95f-3acebb103621 req-79ba592b-72d4-4f18-a91d-4355694e0b61 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:09.368040 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-cb2d5ffb-2e3a-4249-b95f-3acebb103621 req-79ba592b-72d4-4f18-a91d-4355694e0b61 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:09.387108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-cb2d5ffb-2e3a-4249-b95f-3acebb103621 req-79ba592b-72d4-4f18-a91d-4355694e0b61 service nova] Creating event network-changed:604e5f5c-283e-45f1-a867-13e08aeec016 for instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 on hv-cinder-84893 Jul 14 11:25:09.392545 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-cb2d5ffb-2e3a-4249-b95f-3acebb103621 req-79ba592b-72d4-4f18-a91d-4355694e0b61 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040649 Jul 14 11:25:09.393160 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 573/1152] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:45.287915 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:25:45.288519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:26:33.087501 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=26 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:33.088263 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=58 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:33.092371 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-255afefc-3de5-4927-ae33-0f61bb197b03 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:33.092895 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-255afefc-3de5-4927-ae33-0f61bb197b03 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:33.099679 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-255afefc-3de5-4927-ae33-0f61bb197b03 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:33.100129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-255afefc-3de5-4927-ae33-0f61bb197b03 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:33.100896 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-255afefc-3de5-4927-ae33-0f61bb197b03 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:33.101331 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-255afefc-3de5-4927-ae33-0f61bb197b03 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:33.123992 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-255afefc-3de5-4927-ae33-0f61bb197b03 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lazy-loading 'flavor' on Instance uuid 566c5bd4-998b-48a8-90e3-69d2fee07a54 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:26:33.196290 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-255afefc-3de5-4927-ae33-0f61bb197b03 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "POST /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54/action" status: 202 len: 0 microversion: 2.1 time: 0.110322 Jul 14 11:26:33.197100 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 580/1153] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:26:33 2022] POST /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:26:33.203948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b4965821-3f78-40c4-8bbe-4b895c1bd2e7] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 11:26:33.204553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:33.205317 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:33.209579 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f5d9219-1efe-4229-8a06-9e2f65092295 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:33.210267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8f5d9219-1efe-4229-8a06-9e2f65092295 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:33.217470 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f5d9219-1efe-4229-8a06-9e2f65092295 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:33.217902 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f5d9219-1efe-4229-8a06-9e2f65092295 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:33.218647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f5d9219-1efe-4229-8a06-9e2f65092295 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:33.219082 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f5d9219-1efe-4229-8a06-9e2f65092295 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:33.357109 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f5d9219-1efe-4229-8a06-9e2f65092295 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:33.365032 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8f5d9219-1efe-4229-8a06-9e2f65092295 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.163612 Jul 14 11:26:33.365594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 574/1154] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:33 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:34.383256 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-df9c77ab-2711-4a53-b1ae-4055ca1a4ae9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:34.383970 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-df9c77ab-2711-4a53-b1ae-4055ca1a4ae9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:34.390796 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df9c77ab-2711-4a53-b1ae-4055ca1a4ae9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:34.391239 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df9c77ab-2711-4a53-b1ae-4055ca1a4ae9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:34.392022 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df9c77ab-2711-4a53-b1ae-4055ca1a4ae9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:34.392447 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df9c77ab-2711-4a53-b1ae-4055ca1a4ae9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:34.524478 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-df9c77ab-2711-4a53-b1ae-4055ca1a4ae9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:34.531953 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-df9c77ab-2711-4a53-b1ae-4055ca1a4ae9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.153536 Jul 14 11:26:34.532508 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 581/1155] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:34 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:35.549097 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-855875f5-9148-4dff-85ac-6785218cd762 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:35.549661 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-855875f5-9148-4dff-85ac-6785218cd762 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:35.557690 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-855875f5-9148-4dff-85ac-6785218cd762 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:35.558162 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-855875f5-9148-4dff-85ac-6785218cd762 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:35.558939 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-855875f5-9148-4dff-85ac-6785218cd762 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:35.559375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-855875f5-9148-4dff-85ac-6785218cd762 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:35.565375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] [b4965821-3f78-40c4-8bbe-4b895c1bd2e7] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 45608. Jul 14 11:26:35.690877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-855875f5-9148-4dff-85ac-6785218cd762 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:35.698589 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-855875f5-9148-4dff-85ac-6785218cd762 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.153533 Jul 14 11:26:35.699161 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 575/1156] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:35 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:36.716313 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cffacbf9-6ed4-463a-abdf-5b64bac458ab tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:36.717003 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cffacbf9-6ed4-463a-abdf-5b64bac458ab tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:36.723972 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cffacbf9-6ed4-463a-abdf-5b64bac458ab tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:36.724458 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cffacbf9-6ed4-463a-abdf-5b64bac458ab tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:36.725218 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cffacbf9-6ed4-463a-abdf-5b64bac458ab tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:36.725657 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cffacbf9-6ed4-463a-abdf-5b64bac458ab tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:36.856994 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cffacbf9-6ed4-463a-abdf-5b64bac458ab tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:36.865306 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cffacbf9-6ed4-463a-abdf-5b64bac458ab tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.152957 Jul 14 11:26:36.865876 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 582/1157] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:36 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:37.882553 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a5a0d2eb-44f4-4c6b-bada-cdada066a7f0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:37.883164 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a5a0d2eb-44f4-4c6b-bada-cdada066a7f0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:37.889922 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5a0d2eb-44f4-4c6b-bada-cdada066a7f0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:37.890396 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5a0d2eb-44f4-4c6b-bada-cdada066a7f0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:37.891161 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5a0d2eb-44f4-4c6b-bada-cdada066a7f0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:37.891630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5a0d2eb-44f4-4c6b-bada-cdada066a7f0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:38.021639 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a5a0d2eb-44f4-4c6b-bada-cdada066a7f0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:38.029251 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a5a0d2eb-44f4-4c6b-bada-cdada066a7f0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.150576 Jul 14 11:26:38.029817 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 576/1158] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:37 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:39.046216 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-13a3c1f3-bd8f-40b8-913c-3891175f248b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:39.046809 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-13a3c1f3-bd8f-40b8-913c-3891175f248b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:39.053284 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13a3c1f3-bd8f-40b8-913c-3891175f248b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:39.053726 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13a3c1f3-bd8f-40b8-913c-3891175f248b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:39.054473 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13a3c1f3-bd8f-40b8-913c-3891175f248b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:39.054900 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13a3c1f3-bd8f-40b8-913c-3891175f248b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:39.185409 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-13a3c1f3-bd8f-40b8-913c-3891175f248b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:39.193969 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-13a3c1f3-bd8f-40b8-913c-3891175f248b tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.151530 Jul 14 11:26:39.194939 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 583/1159] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:39 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:40.211058 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1c03cfc3-a338-469e-8bd2-6f883f943587 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:40.211699 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1c03cfc3-a338-469e-8bd2-6f883f943587 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:40.218181 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c03cfc3-a338-469e-8bd2-6f883f943587 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:40.218627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c03cfc3-a338-469e-8bd2-6f883f943587 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:40.219994 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c03cfc3-a338-469e-8bd2-6f883f943587 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:40.220426 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c03cfc3-a338-469e-8bd2-6f883f943587 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:40.355865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1c03cfc3-a338-469e-8bd2-6f883f943587 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:40.363228 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1c03cfc3-a338-469e-8bd2-6f883f943587 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.156027 Jul 14 11:26:40.363813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 577/1160] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:40 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:41.380450 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0186c674-ca14-413a-8d37-e320e13dd4a0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:41.381008 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0186c674-ca14-413a-8d37-e320e13dd4a0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:41.387511 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0186c674-ca14-413a-8d37-e320e13dd4a0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:41.387965 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0186c674-ca14-413a-8d37-e320e13dd4a0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:41.388726 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0186c674-ca14-413a-8d37-e320e13dd4a0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:41.389165 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0186c674-ca14-413a-8d37-e320e13dd4a0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:41.520611 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0186c674-ca14-413a-8d37-e320e13dd4a0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:41.528182 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0186c674-ca14-413a-8d37-e320e13dd4a0 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.151709 Jul 14 11:26:41.528757 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 584/1161] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:41 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:42.545234 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-90262714-be08-4c55-8f46-c16ce820bcbd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:42.545774 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-90262714-be08-4c55-8f46-c16ce820bcbd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:42.553011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90262714-be08-4c55-8f46-c16ce820bcbd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:42.553464 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90262714-be08-4c55-8f46-c16ce820bcbd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:42.554236 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90262714-be08-4c55-8f46-c16ce820bcbd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:42.554673 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90262714-be08-4c55-8f46-c16ce820bcbd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:42.690700 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-90262714-be08-4c55-8f46-c16ce820bcbd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:42.698270 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-90262714-be08-4c55-8f46-c16ce820bcbd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.157255 Jul 14 11:26:42.698838 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 578/1162] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:42 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:43.715444 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-58750eee-4af2-4883-aff7-767d83c17a90 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:43.716053 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-58750eee-4af2-4883-aff7-767d83c17a90 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:43.722766 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-58750eee-4af2-4883-aff7-767d83c17a90 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:43.723213 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-58750eee-4af2-4883-aff7-767d83c17a90 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:43.724015 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-58750eee-4af2-4883-aff7-767d83c17a90 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:43.724451 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-58750eee-4af2-4883-aff7-767d83c17a90 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:43.940926 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-58750eee-4af2-4883-aff7-767d83c17a90 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:43.948519 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-58750eee-4af2-4883-aff7-767d83c17a90 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.237050 Jul 14 11:26:43.949046 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 585/1163] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:43 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:44.965480 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d63451c6-9435-447d-b3a2-be894f05057f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:44.966096 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d63451c6-9435-447d-b3a2-be894f05057f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:44.973166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d63451c6-9435-447d-b3a2-be894f05057f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:44.973613 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d63451c6-9435-447d-b3a2-be894f05057f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:44.974373 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d63451c6-9435-447d-b3a2-be894f05057f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:44.974805 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d63451c6-9435-447d-b3a2-be894f05057f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:45.107733 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d63451c6-9435-447d-b3a2-be894f05057f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:45.115801 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d63451c6-9435-447d-b3a2-be894f05057f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.154194 Jul 14 11:26:45.116371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 579/1164] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:44 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:46.133541 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cef220a7-e9f5-4ca0-a7f8-375d0b23eb4d tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:46.134121 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cef220a7-e9f5-4ca0-a7f8-375d0b23eb4d tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:46.140697 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cef220a7-e9f5-4ca0-a7f8-375d0b23eb4d tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:46.141140 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cef220a7-e9f5-4ca0-a7f8-375d0b23eb4d tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:46.141899 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cef220a7-e9f5-4ca0-a7f8-375d0b23eb4d tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:46.142838 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cef220a7-e9f5-4ca0-a7f8-375d0b23eb4d tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:46.289515 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cef220a7-e9f5-4ca0-a7f8-375d0b23eb4d tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:46.297270 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cef220a7-e9f5-4ca0-a7f8-375d0b23eb4d tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.167653 Jul 14 11:26:46.297849 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 586/1165] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:46 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:47.315096 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e08e8654-bb9f-4958-945f-b90a054bce05 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:47.315730 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e08e8654-bb9f-4958-945f-b90a054bce05 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:47.322301 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e08e8654-bb9f-4958-945f-b90a054bce05 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.322747 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e08e8654-bb9f-4958-945f-b90a054bce05 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.323543 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e08e8654-bb9f-4958-945f-b90a054bce05 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.323983 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e08e8654-bb9f-4958-945f-b90a054bce05 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.454383 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e08e8654-bb9f-4958-945f-b90a054bce05 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:47.462540 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e08e8654-bb9f-4958-945f-b90a054bce05 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1511 microversion: 2.1 time: 0.151563 Jul 14 11:26:47.463108 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 580/1166] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:47 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:47.479091 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7863fe59-6de8-40ce-b3fa-467125135d77 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:47.479687 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7863fe59-6de8-40ce-b3fa-467125135d77 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:47.486090 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7863fe59-6de8-40ce-b3fa-467125135d77 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.486537 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7863fe59-6de8-40ce-b3fa-467125135d77 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.487295 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7863fe59-6de8-40ce-b3fa-467125135d77 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.487759 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7863fe59-6de8-40ce-b3fa-467125135d77 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.662878 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7863fe59-6de8-40ce-b3fa-467125135d77 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "POST /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54/action" status: 202 len: 0 microversion: 2.1 time: 0.187547 Jul 14 11:26:47.663823 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 587/1167] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Jul 14 11:26:47 2022] POST /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:26:47.672116 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-206f9d79-fb50-4ba3-a610-bca0ec38ac4f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:47.673178 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-206f9d79-fb50-4ba3-a610-bca0ec38ac4f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:47.678763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-206f9d79-fb50-4ba3-a610-bca0ec38ac4f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.679203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-206f9d79-fb50-4ba3-a610-bca0ec38ac4f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.680006 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-206f9d79-fb50-4ba3-a610-bca0ec38ac4f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.680493 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-206f9d79-fb50-4ba3-a610-bca0ec38ac4f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.854352 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-206f9d79-fb50-4ba3-a610-bca0ec38ac4f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:47.862330 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-206f9d79-fb50-4ba3-a610-bca0ec38ac4f tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1519 microversion: 2.1 time: 0.194080 Jul 14 11:26:47.863078 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 581/1168] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:47 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:48.881161 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0a43d5ef-7a60-42ed-8520-1bfea74f47b9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:48.882189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0a43d5ef-7a60-42ed-8520-1bfea74f47b9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:48.888804 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a43d5ef-7a60-42ed-8520-1bfea74f47b9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:48.889260 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a43d5ef-7a60-42ed-8520-1bfea74f47b9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:48.890031 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a43d5ef-7a60-42ed-8520-1bfea74f47b9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:48.890473 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0a43d5ef-7a60-42ed-8520-1bfea74f47b9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:49.036127 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0a43d5ef-7a60-42ed-8520-1bfea74f47b9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:49.044609 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0a43d5ef-7a60-42ed-8520-1bfea74f47b9 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1521 microversion: 2.1 time: 0.168865 Jul 14 11:26:49.045183 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 588/1169] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:48 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:49.199132 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-83cbdf47-d786-4c41-87d5-657bbd24bf6d req-2805474b-6d66-4e66-93e8-edcdafa0d68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566c5bd4-998b-48a8-90e3-69d2fee07a54", "name": "network-vif-unplugged", "status": "completed", "tag": "4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:49.208216 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-83cbdf47-d786-4c41-87d5-657bbd24bf6d req-2805474b-6d66-4e66-93e8-edcdafa0d68c service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:49.208672 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-83cbdf47-d786-4c41-87d5-657bbd24bf6d req-2805474b-6d66-4e66-93e8-edcdafa0d68c service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:49.221193 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-83cbdf47-d786-4c41-87d5-657bbd24bf6d req-2805474b-6d66-4e66-93e8-edcdafa0d68c service nova] Creating event network-vif-unplugged:4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1 for instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 on hv-cinder-84893 Jul 14 11:26:49.226555 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-83cbdf47-d786-4c41-87d5-657bbd24bf6d req-2805474b-6d66-4e66-93e8-edcdafa0d68c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031255 Jul 14 11:26:49.227243 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 582/1170] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:50.063805 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2ceb2893-2b4e-47e9-8f40-51ef364c0eac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:50.064715 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2ceb2893-2b4e-47e9-8f40-51ef364c0eac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:50.071137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ceb2893-2b4e-47e9-8f40-51ef364c0eac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:50.071797 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ceb2893-2b4e-47e9-8f40-51ef364c0eac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:50.072506 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ceb2893-2b4e-47e9-8f40-51ef364c0eac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:50.072985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ceb2893-2b4e-47e9-8f40-51ef364c0eac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:50.203357 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2ceb2893-2b4e-47e9-8f40-51ef364c0eac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:50.211366 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2ceb2893-2b4e-47e9-8f40-51ef364c0eac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.152524 Jul 14 11:26:50.211964 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 589/1171] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:50 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:51.229919 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8084e172-d936-4bc4-951c-4b8e23edf8ac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:51.230601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8084e172-d936-4bc4-951c-4b8e23edf8ac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:51.236830 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8084e172-d936-4bc4-951c-4b8e23edf8ac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:51.237277 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8084e172-d936-4bc4-951c-4b8e23edf8ac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:51.238026 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8084e172-d936-4bc4-951c-4b8e23edf8ac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:51.238462 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8084e172-d936-4bc4-951c-4b8e23edf8ac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:51.365865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8084e172-d936-4bc4-951c-4b8e23edf8ac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:51.373332 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8084e172-d936-4bc4-951c-4b8e23edf8ac tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.148113 Jul 14 11:26:51.373894 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 583/1172] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:51 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:52.390011 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a04a79fb-d2a9-4d50-a396-1314bdb1f7c6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:52.390601 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a04a79fb-d2a9-4d50-a396-1314bdb1f7c6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:52.397147 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a04a79fb-d2a9-4d50-a396-1314bdb1f7c6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:52.397581 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a04a79fb-d2a9-4d50-a396-1314bdb1f7c6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:52.398334 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a04a79fb-d2a9-4d50-a396-1314bdb1f7c6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:52.398755 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a04a79fb-d2a9-4d50-a396-1314bdb1f7c6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:52.539998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a04a79fb-d2a9-4d50-a396-1314bdb1f7c6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:52.547584 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a04a79fb-d2a9-4d50-a396-1314bdb1f7c6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.161400 Jul 14 11:26:52.548156 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 590/1173] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:52 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:53.566149 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-64ab0aa0-5db1-4b0f-b433-f8b07eec5107 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:53.566754 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-64ab0aa0-5db1-4b0f-b433-f8b07eec5107 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:53.573214 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64ab0aa0-5db1-4b0f-b433-f8b07eec5107 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:53.573658 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64ab0aa0-5db1-4b0f-b433-f8b07eec5107 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:53.574411 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64ab0aa0-5db1-4b0f-b433-f8b07eec5107 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:53.574843 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64ab0aa0-5db1-4b0f-b433-f8b07eec5107 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:53.937281 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-64ab0aa0-5db1-4b0f-b433-f8b07eec5107 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:53.944375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-64ab0aa0-5db1-4b0f-b433-f8b07eec5107 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.382975 Jul 14 11:26:53.944934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 584/1174] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:53 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:54.961110 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-11b5a172-720e-49ac-b784-b2b4d2b5b515 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:54.961721 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-11b5a172-720e-49ac-b784-b2b4d2b5b515 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:54.968304 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11b5a172-720e-49ac-b784-b2b4d2b5b515 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.968748 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11b5a172-720e-49ac-b784-b2b4d2b5b515 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:54.969491 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11b5a172-720e-49ac-b784-b2b4d2b5b515 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.969921 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11b5a172-720e-49ac-b784-b2b4d2b5b515 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:55.099678 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-11b5a172-720e-49ac-b784-b2b4d2b5b515 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:55.107462 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-11b5a172-720e-49ac-b784-b2b4d2b5b515 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.149993 Jul 14 11:26:55.108038 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 591/1175] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:54 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:56.125123 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-23e8402d-230f-4828-b6d9-8b40cac7c813 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:56.125721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-23e8402d-230f-4828-b6d9-8b40cac7c813 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:56.132822 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23e8402d-230f-4828-b6d9-8b40cac7c813 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:56.133267 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23e8402d-230f-4828-b6d9-8b40cac7c813 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:56.134052 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23e8402d-230f-4828-b6d9-8b40cac7c813 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:56.134481 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23e8402d-230f-4828-b6d9-8b40cac7c813 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:56.264659 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-23e8402d-230f-4828-b6d9-8b40cac7c813 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:56.272756 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-23e8402d-230f-4828-b6d9-8b40cac7c813 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.151567 Jul 14 11:26:56.273319 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 585/1176] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:56 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:57.290093 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-631d7ce0-cb9b-4bef-bce5-d3697ee346b6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:57.290705 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-631d7ce0-cb9b-4bef-bce5-d3697ee346b6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:57.297264 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-631d7ce0-cb9b-4bef-bce5-d3697ee346b6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:57.297711 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-631d7ce0-cb9b-4bef-bce5-d3697ee346b6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:57.298486 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-631d7ce0-cb9b-4bef-bce5-d3697ee346b6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:57.298919 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-631d7ce0-cb9b-4bef-bce5-d3697ee346b6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:57.436525 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-631d7ce0-cb9b-4bef-bce5-d3697ee346b6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:57.443998 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-631d7ce0-cb9b-4bef-bce5-d3697ee346b6 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.157811 Jul 14 11:26:57.444574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 592/1177] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:57 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:58.461009 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-60588b1a-0be6-4509-9f6c-964eefbe4514 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:58.461612 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-60588b1a-0be6-4509-9f6c-964eefbe4514 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:58.468175 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-60588b1a-0be6-4509-9f6c-964eefbe4514 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:58.468615 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-60588b1a-0be6-4509-9f6c-964eefbe4514 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:58.469375 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-60588b1a-0be6-4509-9f6c-964eefbe4514 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:58.469802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-60588b1a-0be6-4509-9f6c-964eefbe4514 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:58.603531 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-60588b1a-0be6-4509-9f6c-964eefbe4514 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:58.611631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-60588b1a-0be6-4509-9f6c-964eefbe4514 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.153893 Jul 14 11:26:58.612203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 586/1178] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:58 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:59.627968 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-622f8e6d-6a4e-4124-8ee9-569dd58379a5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:59.628530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-622f8e6d-6a4e-4124-8ee9-569dd58379a5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:59.635223 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-622f8e6d-6a4e-4124-8ee9-569dd58379a5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:59.635707 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-622f8e6d-6a4e-4124-8ee9-569dd58379a5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.636468 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-622f8e6d-6a4e-4124-8ee9-569dd58379a5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:59.636899 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-622f8e6d-6a4e-4124-8ee9-569dd58379a5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.655302 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:59.771651 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-622f8e6d-6a4e-4124-8ee9-569dd58379a5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:59.779029 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-622f8e6d-6a4e-4124-8ee9-569dd58379a5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.155029 Jul 14 11:26:59.779632 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 593/1179] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:59 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:00.796065 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-48f2351b-0eb3-488a-8060-838e57196995 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:00.796650 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-48f2351b-0eb3-488a-8060-838e57196995 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:00.803688 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48f2351b-0eb3-488a-8060-838e57196995 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:00.804128 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48f2351b-0eb3-488a-8060-838e57196995 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:00.804877 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48f2351b-0eb3-488a-8060-838e57196995 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:00.805385 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48f2351b-0eb3-488a-8060-838e57196995 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:00.936457 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-48f2351b-0eb3-488a-8060-838e57196995 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:00.943967 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-48f2351b-0eb3-488a-8060-838e57196995 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.151767 Jul 14 11:27:00.944536 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 587/1180] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:00 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:01.312162 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-9226a4af-8644-489f-8a84-2a82a0e3d2c8 req-3571a3a1-f9d1-43ef-a5af-59fab598fb8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566c5bd4-998b-48a8-90e3-69d2fee07a54", "name": "network-vif-plugged", "status": "completed", "tag": "4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:01.323367 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-9226a4af-8644-489f-8a84-2a82a0e3d2c8 req-3571a3a1-f9d1-43ef-a5af-59fab598fb8a service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:01.324058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-9226a4af-8644-489f-8a84-2a82a0e3d2c8 req-3571a3a1-f9d1-43ef-a5af-59fab598fb8a service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:01.335668 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-9226a4af-8644-489f-8a84-2a82a0e3d2c8 req-3571a3a1-f9d1-43ef-a5af-59fab598fb8a service nova] Creating event network-vif-plugged:4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1 for instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 on hv-cinder-84893 Jul 14 11:27:01.340903 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-9226a4af-8644-489f-8a84-2a82a0e3d2c8 req-3571a3a1-f9d1-43ef-a5af-59fab598fb8a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Jul 14 11:27:01.341665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 594/1181] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:01.961497 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f2544a9-b1e0-4729-b9ef-e34ec7b06aaf tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:01.962101 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f2544a9-b1e0-4729-b9ef-e34ec7b06aaf tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:01.968642 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f2544a9-b1e0-4729-b9ef-e34ec7b06aaf tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:01.969094 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f2544a9-b1e0-4729-b9ef-e34ec7b06aaf tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:01.969860 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f2544a9-b1e0-4729-b9ef-e34ec7b06aaf tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:01.970296 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f2544a9-b1e0-4729-b9ef-e34ec7b06aaf tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:02.109620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0f2544a9-b1e0-4729-b9ef-e34ec7b06aaf tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:02.117653 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f2544a9-b1e0-4729-b9ef-e34ec7b06aaf tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1577 microversion: 2.1 time: 0.160095 Jul 14 11:27:02.118209 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 588/1182] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:01 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:03.135115 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9b209a55-5d03-45ab-ab47-98950153c548 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:03.135872 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9b209a55-5d03-45ab-ab47-98950153c548 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:03.138251 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=33 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:03.144287 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b209a55-5d03-45ab-ab47-98950153c548 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:03.144738 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b209a55-5d03-45ab-ab47-98950153c548 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:03.145504 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b209a55-5d03-45ab-ab47-98950153c548 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:03.145943 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b209a55-5d03-45ab-ab47-98950153c548 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:03.278999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b209a55-5d03-45ab-ab47-98950153c548 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:03.287412 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9b209a55-5d03-45ab-ab47-98950153c548 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1564 microversion: 2.1 time: 0.156450 Jul 14 11:27:03.288006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 595/1183] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:03 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:22.368120 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-693880798", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2122659772", "security_groups": [{"name": "tempest-secgroup-smoke-1504150156"}], "block_device_mapping_v2": [{"uuid": "2a010209-1e3e-4696-b578-a424657b8dd5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba59ba1e-7990-4ba9-88ad-652628c8e3ee"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:22.376753 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=30 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:22.377429 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=86 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:22.484980 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] validate_networks() for [('ba59ba1e-7990-4ba9-88ad-652628c8e3ee', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:27:22.952363 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:27:22.952840 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:27:22.953324 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:27:22.953731 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:27:22.954141 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:27:22.965598 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:22.966037 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:22.966836 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:22.967272 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:22.985760 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Getting quotas for project 67f41dcdf6564bbd910a2285568941a1. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:27:22.990828 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Getting quotas for user d942201423da427b848dfd44b33358b8 and project 67f41dcdf6564bbd910a2285568941a1. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:27:23.056601 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:27:23.058683 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a010209-1e3e-4696-b578-a424657b8dd5',volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:27:23.205480 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR oslo.messaging._drivers.impl_rabbit [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [2214dca9-f4d0-43d1-9ee1-a6891bdbd91d] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 11:27:24.214237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [2214dca9-f4d0-43d1-9ee1-a6891bdbd91d] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 45738. Jul 14 11:27:24.219152 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-184121aa-36f2-4163-b771-77822d5239a4 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.855658 Jul 14 11:27:24.219988 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 589/1184] 10.222.0.75 () {60 vars in 1146 bytes} [Thu Jul 14 11:27:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:27:24.230099 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-39dc066d-66b9-4cf7-ba92-33c5a0ec27dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:24.230994 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-39dc066d-66b9-4cf7-ba92-33c5a0ec27dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:24.232961 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:24.233626 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=10 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:24.289376 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-39dc066d-66b9-4cf7-ba92-33c5a0ec27dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:24.296685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-39dc066d-66b9-4cf7-ba92-33c5a0ec27dd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1094 microversion: 2.1 time: 0.070452 Jul 14 11:27:24.297268 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 596/1185] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:24 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:27:25.314677 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-be40acbf-9c94-4dab-83af-c51fac0d3c88 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:25.315292 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-be40acbf-9c94-4dab-83af-c51fac0d3c88 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:25.368371 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-be40acbf-9c94-4dab-83af-c51fac0d3c88 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:25.375007 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-be40acbf-9c94-4dab-83af-c51fac0d3c88 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1094 microversion: 2.1 time: 0.064922 Jul 14 11:27:25.375608 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 590/1186] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:25 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:26.392111 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2ab3557b-4c7e-4a72-aea0-69e92108d140 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:26.392711 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2ab3557b-4c7e-4a72-aea0-69e92108d140 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:26.446530 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2ab3557b-4c7e-4a72-aea0-69e92108d140 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:26.455923 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2ab3557b-4c7e-4a72-aea0-69e92108d140 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1094 microversion: 2.1 time: 0.067496 Jul 14 11:27:26.456546 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 597/1187] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:26 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:27.472923 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d1223e6-f350-4b14-8172-188f18cb6aa5 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:27.474121 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9d1223e6-f350-4b14-8172-188f18cb6aa5 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:27.530816 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d1223e6-f350-4b14-8172-188f18cb6aa5 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:27.538587 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d1223e6-f350-4b14-8172-188f18cb6aa5 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1094 microversion: 2.1 time: 0.069440 Jul 14 11:27:27.539168 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 591/1188] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:27 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:28.558310 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-028b36e7-68d4-4f1a-a1bb-9df167020a0f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:28.558879 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-028b36e7-68d4-4f1a-a1bb-9df167020a0f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:28.565704 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-028b36e7-68d4-4f1a-a1bb-9df167020a0f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:28.566145 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-028b36e7-68d4-4f1a-a1bb-9df167020a0f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:28.567002 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-028b36e7-68d4-4f1a-a1bb-9df167020a0f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:28.568063 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-028b36e7-68d4-4f1a-a1bb-9df167020a0f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:28.641291 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-028b36e7-68d4-4f1a-a1bb-9df167020a0f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:28.649658 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-028b36e7-68d4-4f1a-a1bb-9df167020a0f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1144 microversion: 2.1 time: 0.097151 Jul 14 11:27:28.650241 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 598/1189] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:28 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:29.666895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dd5bc79c-4872-49f5-a51a-6232b2c6cf33 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:29.667567 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dd5bc79c-4872-49f5-a51a-6232b2c6cf33 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:29.674912 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd5bc79c-4872-49f5-a51a-6232b2c6cf33 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:29.675353 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd5bc79c-4872-49f5-a51a-6232b2c6cf33 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:29.676150 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd5bc79c-4872-49f5-a51a-6232b2c6cf33 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:29.676644 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd5bc79c-4872-49f5-a51a-6232b2c6cf33 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:29.742243 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dd5bc79c-4872-49f5-a51a-6232b2c6cf33 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:29.750140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dd5bc79c-4872-49f5-a51a-6232b2c6cf33 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1210 microversion: 2.1 time: 0.087015 Jul 14 11:27:29.750810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 592/1190] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:29 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:30.769929 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3029d33c-1707-4f55-be2f-5f3d333893ca tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:30.771301 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3029d33c-1707-4f55-be2f-5f3d333893ca tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:30.778408 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3029d33c-1707-4f55-be2f-5f3d333893ca tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:30.778851 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3029d33c-1707-4f55-be2f-5f3d333893ca tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:30.779656 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3029d33c-1707-4f55-be2f-5f3d333893ca tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:30.780082 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3029d33c-1707-4f55-be2f-5f3d333893ca tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:30.813379 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-abeed274-223f-4f85-9f62-f68c2b83cfb2 req-2b96bcc3-81db-4bbb-9995-980150bd6af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a17387-dc11-4e6e-a100-2dabf64b3ab3", "tag": "4e454db3-2e7d-4aa3-9dc9-8070985492b7"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:30.837928 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-abeed274-223f-4f85-9f62-f68c2b83cfb2 req-2b96bcc3-81db-4bbb-9995-980150bd6af5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:30.845744 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-abeed274-223f-4f85-9f62-f68c2b83cfb2 req-2b96bcc3-81db-4bbb-9995-980150bd6af5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:30.881700 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-abeed274-223f-4f85-9f62-f68c2b83cfb2 req-2b96bcc3-81db-4bbb-9995-980150bd6af5 service nova] Creating event network-changed:4e454db3-2e7d-4aa3-9dc9-8070985492b7 for instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 on hv-cinder-84893 Jul 14 11:27:30.889753 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-abeed274-223f-4f85-9f62-f68c2b83cfb2 req-2b96bcc3-81db-4bbb-9995-980150bd6af5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086013 Jul 14 11:27:30.891245 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 593/1191] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:31.086593 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3029d33c-1707-4f55-be2f-5f3d333893ca tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:31.101893 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3029d33c-1707-4f55-be2f-5f3d333893ca tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.335751 Jul 14 11:27:31.102665 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 599/1192] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:30 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:32.121085 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2877faa2-6d50-4c69-af88-8faacb307c5d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:32.121811 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2877faa2-6d50-4c69-af88-8faacb307c5d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:32.128520 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2877faa2-6d50-4c69-af88-8faacb307c5d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:32.128975 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2877faa2-6d50-4c69-af88-8faacb307c5d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:32.129761 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2877faa2-6d50-4c69-af88-8faacb307c5d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:32.130204 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2877faa2-6d50-4c69-af88-8faacb307c5d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:32.275490 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2877faa2-6d50-4c69-af88-8faacb307c5d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:32.283538 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2877faa2-6d50-4c69-af88-8faacb307c5d tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.167088 Jul 14 11:27:32.284143 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 594/1193] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:32 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:33.300999 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-083113d3-23d7-4037-bb0b-cb2f0e4ea01f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:33.302130 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-083113d3-23d7-4037-bb0b-cb2f0e4ea01f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:33.308540 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-083113d3-23d7-4037-bb0b-cb2f0e4ea01f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:33.308982 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-083113d3-23d7-4037-bb0b-cb2f0e4ea01f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:33.309745 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-083113d3-23d7-4037-bb0b-cb2f0e4ea01f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:33.310171 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-083113d3-23d7-4037-bb0b-cb2f0e4ea01f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:33.529691 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-083113d3-23d7-4037-bb0b-cb2f0e4ea01f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:33.538353 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-083113d3-23d7-4037-bb0b-cb2f0e4ea01f tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.241289 Jul 14 11:27:33.539592 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 600/1194] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:33 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:34.556652 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8ec5ce3e-921b-4ca7-93e5-468ffffd9ecd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:34.557210 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8ec5ce3e-921b-4ca7-93e5-468ffffd9ecd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:34.559142 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:34.565290 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ec5ce3e-921b-4ca7-93e5-468ffffd9ecd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:34.565740 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ec5ce3e-921b-4ca7-93e5-468ffffd9ecd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:34.566514 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ec5ce3e-921b-4ca7-93e5-468ffffd9ecd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:34.566948 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ec5ce3e-921b-4ca7-93e5-468ffffd9ecd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:34.702024 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ec5ce3e-921b-4ca7-93e5-468ffffd9ecd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:34.709593 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8ec5ce3e-921b-4ca7-93e5-468ffffd9ecd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.156995 Jul 14 11:27:34.710159 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 595/1195] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:34 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:35.726471 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cb8dcfcf-cb64-496d-ab3c-e83da47e0f0b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:35.727100 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cb8dcfcf-cb64-496d-ab3c-e83da47e0f0b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:35.734002 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cb8dcfcf-cb64-496d-ab3c-e83da47e0f0b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:35.734445 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cb8dcfcf-cb64-496d-ab3c-e83da47e0f0b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:35.735202 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cb8dcfcf-cb64-496d-ab3c-e83da47e0f0b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:35.735654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cb8dcfcf-cb64-496d-ab3c-e83da47e0f0b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:35.877458 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cb8dcfcf-cb64-496d-ab3c-e83da47e0f0b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:35.887647 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cb8dcfcf-cb64-496d-ab3c-e83da47e0f0b tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.165098 Jul 14 11:27:35.888227 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 601/1196] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:35 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:36.905011 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88b732e4-9976-4058-a4f3-357f59d89802 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:36.905611 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88b732e4-9976-4058-a4f3-357f59d89802 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:36.911862 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88b732e4-9976-4058-a4f3-357f59d89802 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:36.912346 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88b732e4-9976-4058-a4f3-357f59d89802 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:36.913111 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88b732e4-9976-4058-a4f3-357f59d89802 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:36.914087 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88b732e4-9976-4058-a4f3-357f59d89802 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:37.048934 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88b732e4-9976-4058-a4f3-357f59d89802 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:37.057218 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88b732e4-9976-4058-a4f3-357f59d89802 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.156047 Jul 14 11:27:37.057796 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 596/1197] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:36 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:38.074719 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-922be7f4-96b7-4905-837c-f4a815f79643 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:38.075359 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-922be7f4-96b7-4905-837c-f4a815f79643 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:38.077223 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:38.083242 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-922be7f4-96b7-4905-837c-f4a815f79643 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:38.083721 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-922be7f4-96b7-4905-837c-f4a815f79643 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:38.084506 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-922be7f4-96b7-4905-837c-f4a815f79643 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:38.085005 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-922be7f4-96b7-4905-837c-f4a815f79643 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:38.307810 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-922be7f4-96b7-4905-837c-f4a815f79643 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:38.316006 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-922be7f4-96b7-4905-837c-f4a815f79643 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.245157 Jul 14 11:27:38.316596 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 602/1198] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:38 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:39.334513 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7c3620ef-d76e-47c5-9b97-ecc94bc57476 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:39.335224 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7c3620ef-d76e-47c5-9b97-ecc94bc57476 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:39.337140 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=10 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:39.343110 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c3620ef-d76e-47c5-9b97-ecc94bc57476 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:39.343593 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c3620ef-d76e-47c5-9b97-ecc94bc57476 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:39.344370 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c3620ef-d76e-47c5-9b97-ecc94bc57476 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:39.344813 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c3620ef-d76e-47c5-9b97-ecc94bc57476 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:39.492689 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7c3620ef-d76e-47c5-9b97-ecc94bc57476 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:39.501351 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7c3620ef-d76e-47c5-9b97-ecc94bc57476 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.170804 Jul 14 11:27:39.501963 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 597/1199] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:39 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:27:40.518180 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2ee0c3ab-5fd4-44b3-9bc5-02dd36cbf07c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:40.518888 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2ee0c3ab-5fd4-44b3-9bc5-02dd36cbf07c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:40.525742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee0c3ab-5fd4-44b3-9bc5-02dd36cbf07c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:40.526186 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee0c3ab-5fd4-44b3-9bc5-02dd36cbf07c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:40.526960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee0c3ab-5fd4-44b3-9bc5-02dd36cbf07c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:40.527419 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2ee0c3ab-5fd4-44b3-9bc5-02dd36cbf07c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:40.684839 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2ee0c3ab-5fd4-44b3-9bc5-02dd36cbf07c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:40.694037 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2ee0c3ab-5fd4-44b3-9bc5-02dd36cbf07c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.179042 Jul 14 11:27:40.694654 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 603/1200] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:40 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:41.712029 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b49480a0-1043-4608-8c71-062715f58a53 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:41.712632 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b49480a0-1043-4608-8c71-062715f58a53 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:41.719312 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b49480a0-1043-4608-8c71-062715f58a53 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:41.719830 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b49480a0-1043-4608-8c71-062715f58a53 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:41.720611 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b49480a0-1043-4608-8c71-062715f58a53 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:41.721038 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b49480a0-1043-4608-8c71-062715f58a53 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:41.938395 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b49480a0-1043-4608-8c71-062715f58a53 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:41.946923 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b49480a0-1043-4608-8c71-062715f58a53 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.239257 Jul 14 11:27:41.947460 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 598/1201] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:41 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:42.964395 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a186ea53-fffd-4289-879a-f9aadebaad0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:42.965014 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a186ea53-fffd-4289-879a-f9aadebaad0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:42.971790 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a186ea53-fffd-4289-879a-f9aadebaad0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:42.972238 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a186ea53-fffd-4289-879a-f9aadebaad0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:42.973007 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a186ea53-fffd-4289-879a-f9aadebaad0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:42.973442 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a186ea53-fffd-4289-879a-f9aadebaad0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:43.125322 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a186ea53-fffd-4289-879a-f9aadebaad0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:43.133694 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a186ea53-fffd-4289-879a-f9aadebaad0e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.173072 Jul 14 11:27:43.134277 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 604/1202] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:42 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:43.624363 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-5ee1d824-1ca8-4ac9-b708-ec91ad310a16 req-59ea5a9d-ca81-4f38-9d74-53b82193e8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a17387-dc11-4e6e-a100-2dabf64b3ab3", "name": "network-vif-plugged", "status": "completed", "tag": "4e454db3-2e7d-4aa3-9dc9-8070985492b7"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:43.634322 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5ee1d824-1ca8-4ac9-b708-ec91ad310a16 req-59ea5a9d-ca81-4f38-9d74-53b82193e8b5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:43.634721 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5ee1d824-1ca8-4ac9-b708-ec91ad310a16 req-59ea5a9d-ca81-4f38-9d74-53b82193e8b5 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:43.648756 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-5ee1d824-1ca8-4ac9-b708-ec91ad310a16 req-59ea5a9d-ca81-4f38-9d74-53b82193e8b5 service nova] Creating event network-vif-plugged:4e454db3-2e7d-4aa3-9dc9-8070985492b7 for instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 on hv-cinder-84893 Jul 14 11:27:43.658081 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-5ee1d824-1ca8-4ac9-b708-ec91ad310a16 req-59ea5a9d-ca81-4f38-9d74-53b82193e8b5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036921 Jul 14 11:27:43.659556 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 599/1203] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:44.150576 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ac4717cc-0b9e-4d36-8bbe-0cce0f47755e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:44.151326 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ac4717cc-0b9e-4d36-8bbe-0cce0f47755e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:44.157942 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac4717cc-0b9e-4d36-8bbe-0cce0f47755e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:44.158395 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac4717cc-0b9e-4d36-8bbe-0cce0f47755e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:44.159166 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac4717cc-0b9e-4d36-8bbe-0cce0f47755e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:44.159636 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac4717cc-0b9e-4d36-8bbe-0cce0f47755e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:44.296240 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ac4717cc-0b9e-4d36-8bbe-0cce0f47755e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:44.303924 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ac4717cc-0b9e-4d36-8bbe-0cce0f47755e tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.157179 Jul 14 11:27:44.304497 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 605/1204] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:44 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:45.322740 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-91611fb5-d4dd-4b7f-ba34-241988337df6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:45.323565 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-91611fb5-d4dd-4b7f-ba34-241988337df6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:45.329647 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91611fb5-d4dd-4b7f-ba34-241988337df6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:45.330098 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91611fb5-d4dd-4b7f-ba34-241988337df6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:45.330874 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91611fb5-d4dd-4b7f-ba34-241988337df6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:45.331304 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91611fb5-d4dd-4b7f-ba34-241988337df6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:45.488733 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-91611fb5-d4dd-4b7f-ba34-241988337df6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:45.500758 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-91611fb5-d4dd-4b7f-ba34-241988337df6 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1266 microversion: 2.1 time: 0.183145 Jul 14 11:27:45.501388 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 600/1205] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:45 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:46.518574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-907cf91f-9c1a-49ff-b583-bfd0b0038ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:46.519115 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-907cf91f-9c1a-49ff-b583-bfd0b0038ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:46.526393 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-907cf91f-9c1a-49ff-b583-bfd0b0038ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:46.526856 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-907cf91f-9c1a-49ff-b583-bfd0b0038ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:46.527653 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-907cf91f-9c1a-49ff-b583-bfd0b0038ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:46.528160 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-907cf91f-9c1a-49ff-b583-bfd0b0038ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:46.668393 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-907cf91f-9c1a-49ff-b583-bfd0b0038ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:46.675969 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-907cf91f-9c1a-49ff-b583-bfd0b0038ed3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1453 microversion: 2.1 time: 0.161291 Jul 14 11:27:46.676550 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 606/1206] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:46 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:46.692804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9c4a1eb7-f2b2-4983-8c87-71b53bec75dc tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:46.693401 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9c4a1eb7-f2b2-4983-8c87-71b53bec75dc tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:46.701085 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c4a1eb7-f2b2-4983-8c87-71b53bec75dc tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:46.701572 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c4a1eb7-f2b2-4983-8c87-71b53bec75dc tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:46.702364 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c4a1eb7-f2b2-4983-8c87-71b53bec75dc tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:46.702802 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c4a1eb7-f2b2-4983-8c87-71b53bec75dc tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:46.849305 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9c4a1eb7-f2b2-4983-8c87-71b53bec75dc tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:46.857685 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9c4a1eb7-f2b2-4983-8c87-71b53bec75dc tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1453 microversion: 2.1 time: 0.168661 Jul 14 11:27:46.858283 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 601/1207] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:46 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:48.624691 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-a5bf92c8-ff3d-49a7-bf45-44c2f238c590 req-7d9a4f8e-4b80-4a4f-bb55-83362f85c5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a17387-dc11-4e6e-a100-2dabf64b3ab3", "tag": "4e454db3-2e7d-4aa3-9dc9-8070985492b7"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:48.634232 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a5bf92c8-ff3d-49a7-bf45-44c2f238c590 req-7d9a4f8e-4b80-4a4f-bb55-83362f85c5b2 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:48.634835 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a5bf92c8-ff3d-49a7-bf45-44c2f238c590 req-7d9a4f8e-4b80-4a4f-bb55-83362f85c5b2 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:48.649189 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-a5bf92c8-ff3d-49a7-bf45-44c2f238c590 req-7d9a4f8e-4b80-4a4f-bb55-83362f85c5b2 service nova] Creating event network-changed:4e454db3-2e7d-4aa3-9dc9-8070985492b7 for instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 on hv-cinder-84893 Jul 14 11:27:48.654898 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-a5bf92c8-ff3d-49a7-bf45-44c2f238c590 req-7d9a4f8e-4b80-4a4f-bb55-83362f85c5b2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033938 Jul 14 11:27:48.655756 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 607/1208] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:28:48.770192 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:48.770932 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=54 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:48.775400 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=28 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:48.776084 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9927e70c-80a9-4a16-87cc-fbb38017c174 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:48.776687 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9927e70c-80a9-4a16-87cc-fbb38017c174 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:48.777219 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=56 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:48.784476 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9927e70c-80a9-4a16-87cc-fbb38017c174 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:48.784920 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9927e70c-80a9-4a16-87cc-fbb38017c174 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:48.786526 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9927e70c-80a9-4a16-87cc-fbb38017c174 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:48.786526 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9927e70c-80a9-4a16-87cc-fbb38017c174 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:48.819763 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9927e70c-80a9-4a16-87cc-fbb38017c174 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:28:48.856763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-cfef7cdf-13e9-4f2e-b110-ae05a1ecd38d req-f3d5a080-01dd-4255-b3da-68142f9659fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566c5bd4-998b-48a8-90e3-69d2fee07a54", "tag": "4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:28:48.866175 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-cfef7cdf-13e9-4f2e-b110-ae05a1ecd38d req-f3d5a080-01dd-4255-b3da-68142f9659fa service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:48.867072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-cfef7cdf-13e9-4f2e-b110-ae05a1ecd38d req-f3d5a080-01dd-4255-b3da-68142f9659fa service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:48.879119 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-cfef7cdf-13e9-4f2e-b110-ae05a1ecd38d req-f3d5a080-01dd-4255-b3da-68142f9659fa service nova] Creating event network-changed:4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1 for instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 on hv-cinder-84893 Jul 14 11:28:48.884987 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-cfef7cdf-13e9-4f2e-b110-ae05a1ecd38d req-f3d5a080-01dd-4255-b3da-68142f9659fa service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113225 Jul 14 11:28:48.892169 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 608/1209] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:28:48.908531 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9927e70c-80a9-4a16-87cc-fbb38017c174 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "DELETE /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 204 len: 0 microversion: 2.1 time: 0.140109 Jul 14 11:28:48.909319 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 602/1210] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:28:48 2022] DELETE /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:28:48.919836 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-120070e8-20c0-42c0-9179-79ce3106ca23 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:48.920354 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-120070e8-20c0-42c0-9179-79ce3106ca23 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:48.928621 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-120070e8-20c0-42c0-9179-79ce3106ca23 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:48.929100 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-120070e8-20c0-42c0-9179-79ce3106ca23 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:48.930633 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-120070e8-20c0-42c0-9179-79ce3106ca23 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:48.931358 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-120070e8-20c0-42c0-9179-79ce3106ca23 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:49.105932 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-120070e8-20c0-42c0-9179-79ce3106ca23 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:49.115424 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-120070e8-20c0-42c0-9179-79ce3106ca23 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.201136 Jul 14 11:28:49.116035 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 609/1211] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:28:48 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:28:50.135060 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2a75d53c-fa41-4937-808f-c65430f15b6a tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:50.135674 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2a75d53c-fa41-4937-808f-c65430f15b6a tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:50.142154 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2a75d53c-fa41-4937-808f-c65430f15b6a tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:50.142593 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2a75d53c-fa41-4937-808f-c65430f15b6a tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:50.143350 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2a75d53c-fa41-4937-808f-c65430f15b6a tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:50.143804 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2a75d53c-fa41-4937-808f-c65430f15b6a tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:50.287572 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2a75d53c-fa41-4937-808f-c65430f15b6a tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:50.295989 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2a75d53c-fa41-4937-808f-c65430f15b6a tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1570 microversion: 2.1 time: 0.165966 Jul 14 11:28:50.296582 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 603/1212] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:28:50 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:28:51.313437 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fc0ddd95-ceb9-4e38-8519-b9803621cc98 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:51.314146 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fc0ddd95-ceb9-4e38-8519-b9803621cc98 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:51.321113 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc0ddd95-ceb9-4e38-8519-b9803621cc98 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:51.321558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc0ddd95-ceb9-4e38-8519-b9803621cc98 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:51.322344 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc0ddd95-ceb9-4e38-8519-b9803621cc98 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:51.322776 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc0ddd95-ceb9-4e38-8519-b9803621cc98 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:51.590239 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fc0ddd95-ceb9-4e38-8519-b9803621cc98 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:51.600176 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fc0ddd95-ceb9-4e38-8519-b9803621cc98 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1451 microversion: 2.1 time: 0.290931 Jul 14 11:28:51.600942 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 610/1213] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:28:51 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1451 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:28:51.627622 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-9e9c3bac-8091-44e4-b994-df5d25089f67 req-cb9192ac-e399-45ef-b19a-9e6a189c8ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566c5bd4-998b-48a8-90e3-69d2fee07a54", "name": "network-vif-deleted", "tag": "4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:28:51.637700 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9e9c3bac-8091-44e4-b994-df5d25089f67 req-cb9192ac-e399-45ef-b19a-9e6a189c8ae7 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:51.638172 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9e9c3bac-8091-44e4-b994-df5d25089f67 req-cb9192ac-e399-45ef-b19a-9e6a189c8ae7 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:51.659806 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-9e9c3bac-8091-44e4-b994-df5d25089f67 req-cb9192ac-e399-45ef-b19a-9e6a189c8ae7 service nova] Creating event network-vif-deleted:4ebd840d-49e5-4bf0-8c7f-3cd6a1fda9e1 for instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 on hv-cinder-84893 Jul 14 11:28:51.668513 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-9e9c3bac-8091-44e4-b994-df5d25089f67 req-cb9192ac-e399-45ef-b19a-9e6a189c8ae7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044575 Jul 14 11:28:51.669480 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 604/1214] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:28:52.620736 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:52.621393 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:52.627763 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:52.628558 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:52.629589 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:52.630200 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:52.666773 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:52.667226 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:52.667837 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lazy-loading 'fault' on Instance uuid 566c5bd4-998b-48a8-90e3-69d2fee07a54 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:28:52.715677 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3d05f3b904c0f999984dda155f1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0b0b647c442b9a682fd37d756400a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:52.724165 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fc2b66a4-44c8-4bc6-8a6f-5cee7895dcdd tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 200 len: 1179 microversion: 2.1 time: 0.108930 Jul 14 11:28:52.724747 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 611/1215] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:28:52 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 1179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:28:53.743357 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:53.744076 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [instance: 566c5bd4-998b-48a8-90e3-69d2fee07a54] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:53.750398 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:53.750844 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:53.751643 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:53.752080 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:53.766028 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] HTTP exception thrown: Instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 could not be found. Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Request method failure captured: Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 HTTP/1.1 Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_y0cVAXqWG8iVGA50qVkrglYD2XLSbfWzLamxDQL1ck4Bgiq52OugUA7z5ILSMKyZoh2Ns3rCM38GdZCdN8SLl8nwlaX7A7Rgy1WwhYxcekZFrjFHZeYlWr_wF1C-mV0AsIcS4GOwCBUgUDelZ3xY1NYR3n4xNBd2gfMv5zjUyuADg Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 67f0b0b647c442b9a682fd37d756400a Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestShelveInstance-624890480 Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:28:53.767743 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/67f0b0b647c442b9a682fd37d756400a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_67f0b0b647c442b9a682fd37d756400a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f0b0b647c442b9a682fd37d756400a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f0b0b647c442b9a682fd37d756400a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestShelveInstance-624890480 Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 67f0b0b647c442b9a682fd37d756400a Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestShelveInstance-624890480 Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-TestShelveInstance-624890480-project Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: 65c3d05f3b904c0f999984dda155f1cf Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestShelveInstance-624890480-project Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 could not be found. Jul 14 11:28:53.769630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': '566c5bd4-998b-48a8-90e3-69d2fee07a54'} Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 could not be found. Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:28:53.771447 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 could not be found. Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 could not be found. Jul 14 11:28:53.774275 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:28:53.777381 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Returning 404 to user: Instance 566c5bd4-998b-48a8-90e3-69d2fee07a54 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:28:53.777381 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8a66786a-63b7-41d3-923c-9234507c0de5 tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54" status: 404 len: 111 microversion: 2.1 time: 0.030494 Jul 14 11:28:53.777381 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 605/1216] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:28:53 2022] GET /compute/v2.1/servers/566c5bd4-998b-48a8-90e3-69d2fee07a54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:28:53.950359 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-27e8135d-b98f-4fcd-b755-6b671a66b5aa tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] Calling method '.version_select at 0x7f579e02fee0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:53.954395 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR oslo.messaging._drivers.impl_rabbit [None req-27e8135d-b98f-4fcd-b755-6b671a66b5aa tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [904ee974-e6ef-438c-8724-a2e8d1d8498d] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 11:28:54.965600 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [None req-27e8135d-b98f-4fcd-b755-6b671a66b5aa tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] [904ee974-e6ef-438c-8724-a2e8d1d8498d] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 45882. Jul 14 11:28:54.987946 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-27e8135d-b98f-4fcd-b755-6b671a66b5aa tempest-TestShelveInstance-624890480 tempest-TestShelveInstance-624890480-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2062368623" status: 202 len: 0 microversion: 2.1 time: 1.041298 Jul 14 11:28:54.988626 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 612/1217] 10.222.0.75 () {58 vars in 1253 bytes} [Thu Jul 14 11:28:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2062368623 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:29:10.240854 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:29:10.241442 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Thu Jul 14 11:29:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:29:12.126574 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:29:12.127454 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:29:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:29:38.381928 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=22 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:38.387502 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-45a6f977-f582-46a9-9e9a-96c3476bbfe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:38.388166 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-45a6f977-f582-46a9-9e9a-96c3476bbfe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:38.388948 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:38.390407 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:38.391158 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:38.393489 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-02f40594-4e4c-4777-af81-4405880938ad req-5f24112a-bdef-4402-86c4-ce57fbd8454f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a17387-dc11-4e6e-a100-2dabf64b3ab3", "tag": "4e454db3-2e7d-4aa3-9dc9-8070985492b7"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:38.398508 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45a6f977-f582-46a9-9e9a-96c3476bbfe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:38.399594 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45a6f977-f582-46a9-9e9a-96c3476bbfe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:38.400583 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45a6f977-f582-46a9-9e9a-96c3476bbfe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:38.401020 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45a6f977-f582-46a9-9e9a-96c3476bbfe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:38.404191 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-02f40594-4e4c-4777-af81-4405880938ad req-5f24112a-bdef-4402-86c4-ce57fbd8454f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:38.404643 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-02f40594-4e4c-4777-af81-4405880938ad req-5f24112a-bdef-4402-86c4-ce57fbd8454f service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:38.416649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-02f40594-4e4c-4777-af81-4405880938ad req-5f24112a-bdef-4402-86c4-ce57fbd8454f service nova] Creating event network-changed:4e454db3-2e7d-4aa3-9dc9-8070985492b7 for instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 on hv-cinder-84893 Jul 14 11:29:38.422737 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-02f40594-4e4c-4777-af81-4405880938ad req-5f24112a-bdef-4402-86c4-ce57fbd8454f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041964 Jul 14 11:29:38.424773 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 613/1218] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:38.432586 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-45a6f977-f582-46a9-9e9a-96c3476bbfe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:29:38.529964 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-45a6f977-f582-46a9-9e9a-96c3476bbfe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "DELETE /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 204 len: 0 microversion: 2.1 time: 0.146200 Jul 14 11:29:38.534237 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 606/1219] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:29:38 2022] DELETE /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:29:38.539880 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fe7acf84-4b76-48b2-ad95-a1e8394be160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:38.540577 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fe7acf84-4b76-48b2-ad95-a1e8394be160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:38.547977 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe7acf84-4b76-48b2-ad95-a1e8394be160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:38.548435 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe7acf84-4b76-48b2-ad95-a1e8394be160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:38.549221 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe7acf84-4b76-48b2-ad95-a1e8394be160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:38.549662 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe7acf84-4b76-48b2-ad95-a1e8394be160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:38.713203 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fe7acf84-4b76-48b2-ad95-a1e8394be160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:38.720985 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fe7acf84-4b76-48b2-ad95-a1e8394be160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1578 microversion: 2.1 time: 0.185325 Jul 14 11:29:38.721646 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 614/1220] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:38 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:39.747708 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bd8feece-5c81-4854-8be1-ce76362b4786 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:39.750367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bd8feece-5c81-4854-8be1-ce76362b4786 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:39.760986 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd8feece-5c81-4854-8be1-ce76362b4786 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:39.761440 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd8feece-5c81-4854-8be1-ce76362b4786 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:39.762263 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd8feece-5c81-4854-8be1-ce76362b4786 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:39.762701 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd8feece-5c81-4854-8be1-ce76362b4786 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:39.902560 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd8feece-5c81-4854-8be1-ce76362b4786 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:39.911461 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bd8feece-5c81-4854-8be1-ce76362b4786 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1578 microversion: 2.1 time: 0.173229 Jul 14 11:29:39.912031 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 607/1221] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:39 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:40.929533 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2b6412c6-1771-49e6-978d-0b3e8c5abd1c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:40.930137 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2b6412c6-1771-49e6-978d-0b3e8c5abd1c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:40.937607 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b6412c6-1771-49e6-978d-0b3e8c5abd1c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:40.938058 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b6412c6-1771-49e6-978d-0b3e8c5abd1c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:40.938874 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b6412c6-1771-49e6-978d-0b3e8c5abd1c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:40.939339 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b6412c6-1771-49e6-978d-0b3e8c5abd1c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:41.208367 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b42e531e-2e3b-4681-95c8-adf9468bed77 req-ddd5a8fe-ccab-4056-ac18-67b85718e873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a17387-dc11-4e6e-a100-2dabf64b3ab3", "name": "network-vif-deleted", "tag": "4e454db3-2e7d-4aa3-9dc9-8070985492b7"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:41.220630 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b42e531e-2e3b-4681-95c8-adf9468bed77 req-ddd5a8fe-ccab-4056-ac18-67b85718e873 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:41.221834 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b42e531e-2e3b-4681-95c8-adf9468bed77 req-ddd5a8fe-ccab-4056-ac18-67b85718e873 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:41.230089 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2b6412c6-1771-49e6-978d-0b3e8c5abd1c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:41.234863 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b42e531e-2e3b-4681-95c8-adf9468bed77 req-ddd5a8fe-ccab-4056-ac18-67b85718e873 service nova] Creating event network-vif-deleted:4e454db3-2e7d-4aa3-9dc9-8070985492b7 for instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 on hv-cinder-84893 Jul 14 11:29:41.239236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2b6412c6-1771-49e6-978d-0b3e8c5abd1c tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 200 len: 1391 microversion: 2.1 time: 0.312792 Jul 14 11:29:41.240212 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 615/1222] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:40 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 1391 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:41.240940 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b42e531e-2e3b-4681-95c8-adf9468bed77 req-ddd5a8fe-ccab-4056-ac18-67b85718e873 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036135 Jul 14 11:29:41.241540 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 608/1223] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:29:42.256716 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:42.257303 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 39a17387-dc11-4e6e-a100-2dabf64b3ab3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:42.263843 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:42.264291 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:42.265051 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:42.265484 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:42.281253 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] HTTP exception thrown: Instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 could not be found. Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Request method failure captured: Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 HTTP/1.1 Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_wbYo6UXWUBTVC7kydSGk_pbaQC2Er5lBw0rgu3SHTt9xRdEBaryd9qy3JdDXjWYUCHkRnlHtCYcsOb8cEH0T_a_LxkltTj4RoiKZkc-3A-lLfCGiI4LTCO6F9y9gelpmZKakmgpIOtukKnpFZ780JPdV1zc9DSIMU4fAXpKVSlgaw Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:29:42.282904 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_67f41dcdf6564bbd910a2285568941a1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: d942201423da427b848dfd44b33358b8 Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 could not be found. Jul 14 11:29:42.284781 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '39a17387-dc11-4e6e-a100-2dabf64b3ab3'} Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 could not be found. Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:42.285808 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 could not be found. Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 could not be found. Jul 14 11:29:42.287635 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:42.289146 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Returning 404 to user: Instance 39a17387-dc11-4e6e-a100-2dabf64b3ab3 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:42.289146 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-56375e9d-7a23-4c54-b2f4-d5bfb203fe73 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3" status: 404 len: 111 microversion: 2.1 time: 0.031668 Jul 14 11:29:42.289146 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 616/1224] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:42 2022] GET /compute/v2.1/servers/39a17387-dc11-4e6e-a100-2dabf64b3ab3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:29:45.358073 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1dd2dd77-c318-4f65-a8c1-4ac3ea58ab36 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:45.358656 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1dd2dd77-c318-4f65-a8c1-4ac3ea58ab36 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:45.359579 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-a201b595-35f1-4887-adf1-85d46d5346e9 req-69914872-64a5-4808-8756-32277f4e2a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df984ff-60fe-4926-9fdb-e33a4fdc82e2", "tag": "604e5f5c-283e-45f1-a867-13e08aeec016"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:45.366361 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1dd2dd77-c318-4f65-a8c1-4ac3ea58ab36 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.366810 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1dd2dd77-c318-4f65-a8c1-4ac3ea58ab36 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.367627 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1dd2dd77-c318-4f65-a8c1-4ac3ea58ab36 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.368120 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1dd2dd77-c318-4f65-a8c1-4ac3ea58ab36 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.369907 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a201b595-35f1-4887-adf1-85d46d5346e9 req-69914872-64a5-4808-8756-32277f4e2a77 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.370428 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a201b595-35f1-4887-adf1-85d46d5346e9 req-69914872-64a5-4808-8756-32277f4e2a77 service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.382863 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-a201b595-35f1-4887-adf1-85d46d5346e9 req-69914872-64a5-4808-8756-32277f4e2a77 service nova] Creating event network-changed:604e5f5c-283e-45f1-a867-13e08aeec016 for instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 on hv-cinder-84893 Jul 14 11:29:45.389483 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-a201b595-35f1-4887-adf1-85d46d5346e9 req-69914872-64a5-4808-8756-32277f4e2a77 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Jul 14 11:29:45.390188 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 617/1225] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:45.396393 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1dd2dd77-c318-4f65-a8c1-4ac3ea58ab36 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:29:45.479326 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1dd2dd77-c318-4f65-a8c1-4ac3ea58ab36 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "DELETE /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 204 len: 0 microversion: 2.1 time: 0.125688 Jul 14 11:29:45.479936 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 609/1226] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:29:45 2022] DELETE /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:29:45.489501 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a968b224-fc80-4bcf-98ff-e09dc15ee160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:45.490502 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a968b224-fc80-4bcf-98ff-e09dc15ee160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:45.496986 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a968b224-fc80-4bcf-98ff-e09dc15ee160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.497441 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a968b224-fc80-4bcf-98ff-e09dc15ee160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.498211 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a968b224-fc80-4bcf-98ff-e09dc15ee160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.498840 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a968b224-fc80-4bcf-98ff-e09dc15ee160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.639072 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a968b224-fc80-4bcf-98ff-e09dc15ee160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:45.647207 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a968b224-fc80-4bcf-98ff-e09dc15ee160 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1579 microversion: 2.1 time: 0.162637 Jul 14 11:29:45.647977 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 618/1227] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:45 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:46.665203 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7f664c89-5e6c-42ac-9b6f-e85e0322ebe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:46.665972 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7f664c89-5e6c-42ac-9b6f-e85e0322ebe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:46.672639 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f664c89-5e6c-42ac-9b6f-e85e0322ebe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:46.673095 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f664c89-5e6c-42ac-9b6f-e85e0322ebe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:46.673865 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f664c89-5e6c-42ac-9b6f-e85e0322ebe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:46.674306 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7f664c89-5e6c-42ac-9b6f-e85e0322ebe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:46.813433 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7f664c89-5e6c-42ac-9b6f-e85e0322ebe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:46.821968 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7f664c89-5e6c-42ac-9b6f-e85e0322ebe3 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1579 microversion: 2.1 time: 0.160840 Jul 14 11:29:46.823012 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 610/1228] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:46 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:47.757448 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-b418cd3d-30ce-44e9-91a0-9c0c423a419b req-cea3e219-65a6-4784-8651-6511b3c811dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df984ff-60fe-4926-9fdb-e33a4fdc82e2", "name": "network-vif-deleted", "tag": "604e5f5c-283e-45f1-a867-13e08aeec016"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:47.766369 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-b418cd3d-30ce-44e9-91a0-9c0c423a419b req-cea3e219-65a6-4784-8651-6511b3c811dd service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:47.767317 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-b418cd3d-30ce-44e9-91a0-9c0c423a419b req-cea3e219-65a6-4784-8651-6511b3c811dd service nova] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:47.779429 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-b418cd3d-30ce-44e9-91a0-9c0c423a419b req-cea3e219-65a6-4784-8651-6511b3c811dd service nova] Creating event network-vif-deleted:604e5f5c-283e-45f1-a867-13e08aeec016 for instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 on hv-cinder-84893 Jul 14 11:29:47.785627 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-b418cd3d-30ce-44e9-91a0-9c0c423a419b req-cea3e219-65a6-4784-8651-6511b3c811dd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031543 Jul 14 11:29:47.786337 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 619/1229] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Jul 14 11:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:47.838666 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b75963b8-2c2d-46b9-9a9f-2a6661843843 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:47.839262 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b75963b8-2c2d-46b9-9a9f-2a6661843843 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:47.847648 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b75963b8-2c2d-46b9-9a9f-2a6661843843 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:47.848090 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b75963b8-2c2d-46b9-9a9f-2a6661843843 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:47.849031 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b75963b8-2c2d-46b9-9a9f-2a6661843843 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:47.849529 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b75963b8-2c2d-46b9-9a9f-2a6661843843 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:47.911842 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b75963b8-2c2d-46b9-9a9f-2a6661843843 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd942201423da427b848dfd44b33358b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f41dcdf6564bbd910a2285568941a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:47.919655 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b75963b8-2c2d-46b9-9a9f-2a6661843843 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 200 len: 1226 microversion: 2.1 time: 0.084683 Jul 14 11:29:47.920165 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 611/1230] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:47 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:48.937561 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:48.938256 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: 4df984ff-60fe-4926-9fdb-e33a4fdc82e2] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:48.945529 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:48.945960 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:48.946738 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:48.947172 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:48.961240 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] HTTP exception thrown: Instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 could not be found. Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Request method failure captured: Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 HTTP/1.1 Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_wbYo6UXWUBTVC7kydSGk_pbaQC2Er5lBw0rgu3SHTt9xRdEBaryd9qy3JdDXjWYUCHkRnlHtCYcsOb8cEH0T_a_LxkltTj4RoiKZkc-3A-lLfCGiI4LTCO6F9y9gelpmZKakmgpIOtukKnpFZ780JPdV1zc9DSIMU4fAXpKVSlgaw Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:29:48.962912 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_67f41dcdf6564bbd910a2285568941a1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: d942201423da427b848dfd44b33358b8 Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 could not be found. Jul 14 11:29:48.964685 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': '4df984ff-60fe-4926-9fdb-e33a4fdc82e2'} Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 could not be found. Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:48.965649 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 could not be found. Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 could not be found. Jul 14 11:29:48.967236 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:48.968696 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Returning 404 to user: Instance 4df984ff-60fe-4926-9fdb-e33a4fdc82e2 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:48.968696 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a7acb40f-5650-46a9-a91a-c51977971301 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2" status: 404 len: 111 microversion: 2.1 time: 0.031355 Jul 14 11:29:48.968696 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 620/1231] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:48 2022] GET /compute/v2.1/servers/4df984ff-60fe-4926-9fdb-e33a4fdc82e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:29:49.431524 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:49.432039 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:49.438895 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.439436 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.440200 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.440634 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.454988 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] HTTP exception thrown: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Request method failure captured: Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a HTTP/1.1 Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept: application/json Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Connection: close Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Host: 10.222.0.75 Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiz_wbYo6UXWUBTVC7kydSGk_pbaQC2Er5lBw0rgu3SHTt9xRdEBaryd9qy3JdDXjWYUCHkRnlHtCYcsOb8cEH0T_a_LxkltTj4RoiKZkc-3A-lLfCGiI4LTCO6F9y9gelpmZKakmgpIOtukKnpFZ780JPdV1zc9DSIMU4fAXpKVSlgaw Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jul 14 11:29:49.456620 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_67f41dcdf6564bbd910a2285568941a1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Id: d942201423da427b848dfd44b33358b8 Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: method: > Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: exception: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.458348 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: action_args: {'id': 'a7e09bb3-a737-40f6-b960-8d581524e93a'} Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:49.459286 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.460631 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.461961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Returning 404 to user: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:49.461961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3fa925d6-1afe-4354-9b66-a27faed28375 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 404 len: 111 microversion: 2.1 time: 0.030374 Jul 14 11:29:49.461961 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 612/1232] 10.222.0.75 () {58 vars in 1238 bytes} [Thu Jul 14 11:29:49 2022] DELETE /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:29:49.466732 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:49.467346 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] [instance: a7e09bb3-a737-40f6-b960-8d581524e93a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:49.474431 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.474888 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.475702 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.476168 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Lock "9e1441d4-0d48-4768-9ce5-52c16a7d55c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.490611 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] HTTP exception thrown: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Request method failure captured: Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a HTTP/1.1 Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept: application/json Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Connection: close Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Host: 10.222.0.75 Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiz_wbYo6UXWUBTVC7kydSGk_pbaQC2Er5lBw0rgu3SHTt9xRdEBaryd9qy3JdDXjWYUCHkRnlHtCYcsOb8cEH0T_a_LxkltTj4RoiKZkc-3A-lLfCGiI4LTCO6F9y9gelpmZKakmgpIOtukKnpFZ780JPdV1zc9DSIMU4fAXpKVSlgaw Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jul 14 11:29:49.492201 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_67f41dcdf6564bbd910a2285568941a1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/67f41dcdf6564bbd910a2285568941a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 67f41dcdf6564bbd910a2285568941a1 Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-TestVolumeBootPattern-870017182 Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Id: d942201423da427b848dfd44b33358b8 Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-TestVolumeBootPattern-870017182-project Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: method: > Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: exception: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.494871 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: action_args: {'id': 'a7e09bb3-a737-40f6-b960-8d581524e93a'} Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:49.496956 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. Jul 14 11:29:49.499329 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.502826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Returning 404 to user: Instance a7e09bb3-a737-40f6-b960-8d581524e93a could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:49.502826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d9c92b48-0b68-4257-b119-69d994eaf5fd tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a" status: 404 len: 111 microversion: 2.1 time: 0.030761 Jul 14 11:29:49.502826 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 621/1233] 10.222.0.75 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:49 2022] GET /compute/v2.1/servers/a7e09bb3-a737-40f6-b960-8d581524e93a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:29:50.790645 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a5a30cd3-2d51-4e88-9ce9-e01c55384775 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] Calling method '.version_select at 0x7f579de25700>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:50.828734 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a5a30cd3-2d51-4e88-9ce9-e01c55384775 tempest-TestVolumeBootPattern-870017182 tempest-TestVolumeBootPattern-870017182-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2122659772" status: 202 len: 0 microversion: 2.1 time: 0.041847 Jul 14 11:29:50.829417 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 613/1234] 10.222.0.75 () {58 vars in 1262 bytes} [Thu Jul 14 11:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2122659772 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:32:30.250290 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:32:30.251025 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Thu Jul 14 11:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:32:32.135101 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:32:32.135784 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:32:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:32:38.566687 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:32:38.567254 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Thu Jul 14 11:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:32:59.134925 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:32:59.135815 dv-cinder-848938-2-iscsi devstack@n-api.service[117889]: Thu Jul 14 11:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:33:01.352503 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:33:01.353129 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:33:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:34:05.301135 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:34:05.301742 dv-cinder-848938-2-iscsi devstack@n-api.service[117888]: Thu Jul 14 11:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!